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Summary 

The first two years research work has advanced the inversion-based guidance theory for: 

• systems with non-hyperbolic internal dynamics; 

• systems with parameter jumps; 

• systems where a redesign of the output trajectory is desired; and 

• the generation of recovery guidance maneuvers. 

Non-hyperbolic Internal Dynamics 

Output tracking for nonminimum phase nonlinear systems with non-hyperbolic and near 
non-hyperbolic internal dynamics was developed. This approach integrated stable inversion 
techniques, that achieve exact-tracking, with approximation techniques, that modify the 
internal dynamics to achieve desirable performance [1], Such modification of the internal 
dynamics was used (a) to remove non-hyperbolicity which is an obstruction to applying 
stable inversion techniques and (b) to reduce large preactuation times needed to apply stable 
inversion for near non-hyperbolic cases. This approach has been extended to nonlinear 
systems [2]. 

Systems with Parameter Jumps 

The exact output tracking problem for systems with parameter jumps was considered [3]. 
Necessary and sufficient conditions were derived for the elimination of switching-introduced 
output transient. While previous works had studied this problem by developing a regula- 
tor that maintains exact tracking through parameter jumps (switches), such techniques are, 
however, only applicable to minimum-phase systems. In contrast, our approach is also appli- 
cable to nonminimum-phase systems and leads to bounded but possibly non-causal solutions. 
In addition, for the case when the reference trajectories are generated by an exosystem, we 
developed an exact-tracking controller which could be written in a feedback form. As in 
standard regulator theory, we also obtained a linear map from the states of the exosystem to 
the desired system state, which was defined via a matrix differential equation. The constant 
solution of this differential equation provided asymptotic tracking, and coincided with the 
feedback law used in standard regulator theory. 

Work has been initiated to connect this work to the control of hybrid systems. 

Output Trajectory Redesign 

We studied the optimal redesign of output trajectory for linear invertible systems [4, 5]. 
The specified output trajectory uniquely determines the required input and state trajectories, 
that are found through inversion. These input-state trajectories exactly track the desired 
output, however, they might not meet acceptable performance requirements. For example, 
the required inputs might cause actuator-saturation during an exact tracking maneuver, for 
example, in the flight control of conventional take-off and landing aircraft. In such situations, 
a compromise is desired between the tracking requirement and other goals like reduction of 
internal vibrations and prevention of actuator saturation - the desired output trajectory 




needs to be redesigned. We posed the trajectory redesign problem as an optimization of a 
general quadratic cost function, and solved it in the context of linear systems. 

This theory is currently being extended to nonlinear systems, and will be applied to (a) 
the flight control of conventional take-off and landing aircraft and (b) to the guidance of the 
landing maneuvers for the Space Shuttle. Results will be submitted to the 1998 CDC and 
the 1998 AIAA Conference on Guidance and Navigation (and to the related journals). 

Recovery Guidance Maneuvers for Linear Systems 

We studied the development of recovery guidance maneuvers for linear systems which 
may have actuator-saturation or actuator rate-limits [6]. Note that if a fixed regulator 
is used to stabilize a desired state trajectory (guidance law), large initial tracking errors 
can lead to input saturation, which can result in performance deterioration. A method to 
modify the guidance law for recovering state-trajectory tracking (without violating input and 
state constraints) was developed. Although it may be usually feasible to find a satisfactory 
recovery guidance maneuver for a given initial tracking error, online development of recovery 
guidance maneuvers may not be computationally tractable. A technique was also developed 
to use precomputed recovery guidance maneuvers (for a finite set of initial tracking errors) 
to generate recovery guidance maneuvers for other initial errors. The technique was applied 
to an illustrative example with input-magnitude-limits and input-rate-limits. 

The convexity arguments used in this work, along with our results for switched systems, 
will form the basis of future research into hybrid systems. 
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A technique to achieve output tracking for nonminimum phase linear systems with nonhyperbolic and near 
nonhyperbolic internal dynamics is presented. This approach integrates stable inversion techniques, which achieve 
exact tracking, with approximation techniques, which modify the internal dynamics, to achieve desirable perfor- 
mance. Such modification of the internal dynamics is used 1) to remove nonhyperbolicity, which is an obstruction to 
applying stable inversion techniques, and 2) to reduce large preactuation times needed to apply stable inversion for 
near nonhyperbolic cases. The method is applied to an example helicopter hover control problem with near nonhy- 
perbolic internal dynamics for illustrating the tradeoff between exact tracking and reduction of preactuation time. 


I. Introduction 

P RECISION output tracking controllers are needed to meet in- 
creasingly stringent performance requirements in applications 
such as flexible structures, aircraft and air traffic control, robotics, 
and manufacturing systems. Although perfect tracking of mini- 
mum phase systems is relatively easy to achieve, output tracking 
of nonminimum phase systems tends to be more challenging due 
to fundamental limitations on transient tracking performance. 1 This 
poor transient performance has been mitigated by using preactua- 
tion in the stable inversion-based approaches for nonminimum phase 
systems. 2 * 5 However, the required preactuation time (during which 
most of the preactuation control effort is required) is large if the zeros 
of a linear system that lie on the open right-half of the complex plane 
are close to the imaginary axis. In the limiting case, with the zeros 
on the imaginary axis (nonhyperbolic internal dynamics), presently 
available inversion-based techniques fail because the preactuation 
time needed becomes infinite. We present a design technique for 
output tracking of linear nonminimum phase systems, which have 
nonhyperbolic and near nonhyperbolic nonminimum phase internal 
dynamics. This technique is then applied to an example helicopter 
hover control problem, and simulation results are presented. 

Output tracking has a long history marked by the development 
of regulator theory for linear systems by Francis and Wonham 6 
and the generalization to the nonlinear case by Isidori and Byrnes. 7 
These approaches asymptotically track an output from a class of 
exosy stem-generated outputs. Further, the Isidori-Byrnes regulator 
has been extended in Refs. 8 and 9 and computational issues have 
been studied in Refs. 1 0 and 1 1 . Although nonlinear regulator design 
is computationally difficult, the linear regulator is easily designed 
by solving a manageable set of linear equations. A problem, how- 
ever, with the regulator approach is that the exosystem states are 
often switched to describe the desired output; this leads to transient 
tracking errors after the switching instants. Such switching-caused 
transient errors can be avoided by using inversion-based approaches 
to output tracking. 4 12 Thus, it is advantageous to use inversion- 
based output tracking when precision tracking of a particular output 
trajectory is required. 

Inversion, which is key to our approach, was restricted to 
causal inverses of minimum phase systems in the early works by 
Silverman 13 and Hirschorn 14 because these approaches lead to un- 
bounded inverses in the nonminimum phase case. Di Benedetto 
and Lucibello 15 considered the inversion of time varying nonmini- 
mum phase systems with a choice of the system’s initial conditions. 
Instead of choosing initial conditions, preactuation was used by 
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noncausal stable inversion techniques developed in Refs. 2-5 and 1 6. 
Such noncausal inverses, which require preactuation, have been suc- 
cessfully applied to the output tracking of flexible structures 1718 and 
aircraft and air traffic control. 19 20 However, the fundamental limita- 
tion of presently available inversion schemes is that they fail if the in- 
ternal dynamics is nonhyperbolic. Even when the internal dynamics 
is hyperbolic, if the right-half-plane zeros of the system are close to 
the imaginary axis (the near nonhyperbolic case), then the required 
preactuation time tends to become unacceptably large. In summary, 
output tracking remains a challenge for nonminimum phase systems 
with nonhyperbolic or near nonhyperbolic internal dynamics. 

There are several approximation-based output tracking tech- 
niques, where the central philosophy is to replace the internal dy- 
namics with a dynamics that provides satisfactory behavior, and 
then to develop the controller based on the altered system. 21-23 The 
technique most relevant to this paper is developed by Gopalswamy 
and Hedrick, 23 where trajectory modifications are considered to sta- 
bilize the internal dynamics. This technique, however, requires hy- 
perbolicity of the internal dynamics for computational purposes. 
The development of computational techniques for stable inversion 
(e.g., Ref. 16) motivates the present integration of the stable inver- 
sion scheme with approximation techniques, especially for systems 
with nonhyperbolic internal dynamics where the existing stable in- 
version techniques fail. However, instead of stabilizing the unstable 
internal dynamics, we only aim to modify the nonhyperbolic behav- 
ior with a small perturbation of the internal dynamics. Additionally, 
in nonminimum phase systems with near nonhyperbolic internal dy- 
namics, the present approach allows a tradeoff between the precision 
tracking requirement and the amount of preactuation time needed 
to apply the stable inversion-based output tracking technique. 

The approximate inversion-based technique is developed in 
Sec. II, and the technique is applied to a helicopter hover control 
example in Sec. Ill, where simulation results are discussed. Conclu- 
sions are in Sec. IV. 


II. Stable Inversion 
A. Inversion-Based Output Tracking Scheme 

Here we describe how the inversion approach is used to develop 
output tracking controllers. Consider a linear system described by 

ir(r) = Aat(D -f- Bu(t), y(t) = Cx{t) (1) 


which has the same number of inputs as outputs, n(/),y(/) e W\and 
x(r) € 1)1". Lety,/(-) be the desired output trajectory to be tracked. 
Then in the inversion-based approach, first, we find a nominal input- 
state trajectory [wn (•), * rc f(’)] that satisfies the system equations (I) 
and yields the desired output exactly, i.e., 


* rc r(0 = Ax nf (t) + Bu a (t) 
yAO = Cx rcf (t) 


V/ € (— oo, oo) (2) 
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Fig. 1 Control scheme. 


The system equation ( 1 ) can then be rewritten in the new coordinates 
as 


£(/) = + A 2 rf + B\U 

MO — + A 4 rj + B 2 u 


(6) 

(7) 


where 

A := T~ l AT 


[A. A 2 1 

U 3 Aa\ 


and B - 


= T B 


Second, we stabilize the exact-output yielding state trajectory x rc f( ) 
by using state feedback (see Fig. l).Thus,x(r) — ► x re f(/) andy(/) 
y (i {t) as / — ¥ oo, and output tracking is achieved. It is noted that 
in this output tracking scheme, the reference state trajectory x ref ( ) 
and the feedforward input Ufr(-) are computed off-line. Whereas 
stabilization of the reference state trajectory can be easily achieved 
through standard techniques 24 such as state feedback of the form 
AT[x(0 -x rct (/)], the main challenge is to find the inverse input-state 
trajectory [!%(•), x rc r(*)]i especially for systems with nonminimum 
phase dynamics. This paper addresses the off-line computation of 
the inverse input-state trajectory for a given desired trajectory,^ (*). 

B. Internal Dynamics 

In this subsection, it is shown that finding the inverse input-state 
trajectory is equivalent to finding bounded solutions to the system’s 
internal dynamics. Let the linear system ( 1 ) have a well-defined vec- 
tor relative degree, r := [rj, r 2 r p ]. Then the output’s deriva- 

tives are given as 25 

= C t A rt x + C t A'*-'Bu (3) 

dr* 

where C k is the &th row of C and 1 < k < p. In vector notation, let 
Eq. (3) be rewritten as 

y ir) (t) = A x x(t ) + B y u(t) (4) 


In the new coordinates, the control law for maintaining exact track- 
ing [Eq. (5)] can be written as 

■(0 = - a { Ci( 0 - A,i?(0] (8) 

where 



Note that the desired £(•) is known when the desired output tra- 
jectory y rf ( ) and the output’s time derivatives are specified. This 
desired £(•) is defined as Inasmuch as the control law was 

chosen such that exact tracking is maintained, > ,{r) (0 = , we 

also have £(/) = £ f/ (/), and Eqs. (6) and (7) become 

C(0 = <rf(0 (9) 

m = A , C + A tV + - A<CAD - A n v(t)] (10) 

This is the inverse system, and in particular, Eq. ( 10) is the internal 
dynamics. Solving the internal dynamics is key to finding the inverse 
input-state trajectories. If a bounded solution 7^(0 to the internal 
dynamics (1 0) can be found, then the feedforward input can be found 
through Eq, (8) as 


where 


y 


(r) — 


d n ^ 

d t n 


d r2 y2 

d t r 2 






"CiiV'-'fl" 

A x := 

C 2 A r > 

B y := 

C 2 A^-'B 


C P A'*_ 


_C p A r >’~ 1 B _ 


and By is invertible because of the well-defined relative degree as- 
sumption. Equation (4) motivates the choice of the control law of 
the form 


U„{t) = B;' [/?«)- A x x«)] (5) 

for all / e (— oo, oo). Substituting this control law in Eq. (4), it is 
seen that exact tracking is maintained, i.e., 

y r> (0 =yH } (0 


To study the effect of this control law, consider a change of coordi- 
nates T such that 25 


C(0 

v(0_ 


= Tx(t) 


where C(0 consists of the output and its time derivatives 


C<0 := 




do-1 

dr r i" l yi 


>’2. 


d r2_ 1 

dt r l- ] y 2 ' 


• • • * y P , y P > 


d r i> ~ 1 
df'>“ 1 y / , 


Htr(f) = B;'[y%\t) - A ( CriU) ~ A„VA»] 


and the reference trajectory can be found as 


•K'refO) — 


,fc rf (o 

vAO 


(ID 


Thus, a bounded solution to the internal dynamics (10) is required 
to find the inverse and to apply the output tracking scheme shown 
in Fig. 1. 


C. Modified Internal Dynamics 

Standard inversion schemes 1314 that integrate (forward in time) 
the internal dynamics (10) lead to unbounded solutions because 
the internal dynamics is unstable for nonminimum phase systems. 
Noncausal inversion (e.g., Ref. 4) leads to a bounded but noncausal 
solution to the internal dynamics. Such stable inversion techniques 
are, however, not applicable to systems with nonhyperbolic internal 
dynamics. In this subsection a compromise between stable inversion 
and approximation-based inversion schemes is proposed. The key is 
to modify the internal dynamics by giving up exact output tracking, 
enough to remove the nonhyperbolicity, and then to apply stable 
inversion. Note that the system zeros are not being modified by 
output feedback (which is impossible): rather, the inverse system 
is perturbed to a nearby system, which has better behaved internal 
dynamics, for stable inversion. The difference between the proposed 
technique and other approximation techniques is that the internal 
dynamics is perturbed only to remove the nonhyperbolicity and not 
to stabilize the entire internal dynamics. 

To change the nonhyperbolicity of the internal dynamics, an extra 
term, v(t), is added to the control law (8) as follows: 

«ir(0 = - A<m ~ A<Mt) + v(/)] (12) 





DEVASIA 


575 


With this modified control law, the inverse system [Eqs. (9) and ( 1 0)] 
becomes 


d X(0l _ £pc(') 

d/|_Tj(/)_ jn(t) 


+ G y Y d (t) + G v v(t) 


03) 


where e^(t) := C(0~C/0 is the error in the output and the output’s 
derivatives, 


o 


rfliVl 

L(-4 3 -e 2 B;M c ) (Ai - B 2 B;'A n )_ 

, G v = 

* > 

BiB;' 


0 0 


' Crf(0‘ 

_(a 3 - B 2 B;'A<) b 2 b-'_ 

. YdO) = 



A* := diag [A l ,A 2 A p ] 


where each A,- is an ri x r ( zero-matrix with ones on the elements 
above the main diagonal (for all 1 < i < p). 

Assuming that the original system (A, B) is controllable, we also 
have (5, G v ) controllable, and hence there exists a feedback of the 
form 


v(/) = 


F 


>c(0 

_v (0 


(14) 


such that the modified inverse system (13) is hyperbolic; i.e., all 
poles on the imaginary axis are moved. Note that this change to 
an hyperbolic system can be achieved through arbitrarily small F 
because nonhyperbolicity is not a structurally stable property. The 
hyperbolic system 



is the modified inverse system. This modification of the internal 
dynamics can also be used to move unstable poles of the inverse 
system that may be close to the imaginary axis for reducing the 
required preactuation time. Next, stable inversion of the modified 
inverse system is carried out. 4 


D, Computation of the Inverse 

We begin by decoupling the modified inverse system (15) into 
stable (z,) and unstable (zj subsystems. Because the modified in- 
verse system is hyperbolic, there exits a decoupling transformation 
U such that the modified inverse system (15) can be written as 


zAD = S s zAt ) + G s Y d (t ) , 


where 


z(t) 


zAt) 

z u (t) 


z u (t) = S u z u (t) +G u Y (l {t) 

(16) 


= U 


e< (t) 
v(t) 


(17) 


To find bounded solutions to the unstable inverse systems, the 
boundary conditions that z,(-o o) = 0 and z H (oo) = 0 are applied 
to Eq. (16). This leads to unique bounded solutions to the modified 
inverse system by flowing the stable subsystem forward in time and 
flowing the unstable system backward in time as 



s ’ ( '- r, G u Y d (r)dz 


e s - < ’- r> G u YAT)dz 


V/ e ( — oo, oo ) 

(18) 

V7 e (—oo, oo) 


Lemma: 

1) Let the support of K^(-) be contained in [/ y , oo) for some 

2) Let all of the unstable poles of internal dynamics represented 
by the eigenvalues of lie to the right, in the complex plane, of the 
line Refy) = a for some positive a. 

3) Let \\G u Y d (-)\\ 00 <p. 

Then there exists M such that HMOIIoc < Me a{x ~^ for all time 
before the start of the maneuver, t < t {) . 

Proof: From condition 2 of the Lemma, there exists a positive 
constant M Su such that 

V/< r (19) 

Then for all t < r () , 

ll“rr(Olloo = ||fl;'[)£V) - A, at) ~ A n r](t) + v(r)] \\ x 

from Eq. (12) 

from condition 1 of Lemma 



from Eq. (14) and condition 1 of Lemma 



because z s {t) = 0 for all t < t () 

II f x 

= Pdl 0 cllt/- 1 lloc, / e 5 ^' - G U Y At) di 

II Jt Hoc 

from Eq. (18) 

li c 00 

= ll^^llocllt/'lloo / ^“ ( '- r >G„y rf (r)dr 

II Jh) oo 

from condition I of Lemma 

/'OO 

<PMs u \\A u \\ x \\U-'\l 00 e^dz 

Jro 

from Eq. (19) and condition 3 of the Lemma. Integrating the pre- 
ceding expression, we get 

ll«ir(/)|lao < (/?^,./a)||/\ f/ || 0C ||G“ l || 00 e“'<'-'«) 

;= Me***"*'' 


which concludes the proof. □ 

The Lemma states that the preactuation input tends to zero expo- 
nentially, as we go back in time from the start of the maneuver at /o. 
The rate at which the preactuation becomes zero can be increased 
by moving the unstable poles of the modified inverse away from the 
imaginary axis at the expense of exact output tracking. The tradeoff 
between exact tracking of the desired output and reduction of the 
preactuation time is illustrated in the following example. 


This completes the technique. To summarize, the bounded solu- 
tion (18) is used to find the reference state trajectory as jr rcf (r) — 
T~ l U~ l z ( i(t) and to find the feedforward input «ff(-) from Eq. (12). 
This inverse, [«**(*)> x rc i(‘)L is then used in the control scheme 
shown in Fig. 1 to obtain output tracking. 

E. Preactuation Time and Unstable Poles of the Inverse System 
The connection between the amount of preactuation time required 
to apply the inversion-based feedforward input and the unstable 
poles of the modified inverse is established in the following Lemma. 


III. Example: Helicopter Hover Control 

Here, we apply the output-tracking technique to the hover con- 
trol of a Bell 205 helicopter, which has near nonhyperbolic unstable 
internal dynamics. We consider one of the cases studied in Ref. 26, 
wherein the aircraft dynamics was trimmed at a nominal 5-deg pitch 
attitude, with a midrange weight and a midposition center of grav- 
ity and operating in-ground effect at near sea level. The linearized 
model is given as 26 27 

x = Ax + Bu (20) 
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where 
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(23) 


where U is forward velocity, W vertical velocity, Q pitch rate, V 
lateral velocity, P roll rate, R yaw rate, 9 pitch attitude, and <t> roll 
attitude, and 


where 8 C is collective, S R longitudinal cyclic, & A lateral cyclic, and 
& F tail rotor collective. 

It is noted that the helicopter’s actual dynamic behavior differs 
because of modeling errors such as nonlinearities and unmodeled 
dynamics. In output tracking control schemes that depend on the 
model, such modeling errors need to be corrected through feed- 
back in the control scheme (see Fig. 1). In particular, modeling 
errors can be compensated by robust stabilization of the reference 
state trajectory (see, for example, Ref. 26). The goal is to develop 
inversion-based feedforward and reference state trajectories for use 
in the control scheme shown in Fig. 1. In the following, we apply 
the inversion technique to control the helicopter’s forward, lateral, 
and vertical velocities and its yaw rate. The forward velocity and the 
yaw rate are to be kept at zero, and the desired profiles of lateral and 
vertical velocities and accelerations are as shown in Figs. 2 and 3. 


A. Internal Dynamics 

To find the internal dynamics, we begin with a change in the 
coordinates. Let C be defined as the outputs 


«0 


“£/(/)“' 

W(t) 

V{t) 

R{t)_ 


(25) 


and let rj be the remaining states 
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time (s) 

Fig. 4 Lateral and vertical velocity achieved by the inverse reference state trajectory: 
dynamics and , with modification. 


5 10 

exact-tracking case without modification of the interna! 


In the (£, r}) coordinate system, given by 


at) 


1 0 0 0 0 0 0 
0 10 0 0 0 0 
0 0 0 10 0 0 
0 0 0 0 0 10 
0 0 10 0 0 0 
0 0 0 0 0 0 1 
0 0 0 0 10 0 
0 0 0 0 0 0 0 


o' 

0 

0 

0 

0 

0 

0 

1 


*(/) 


:= Tx(t) 


(27) 


the system equations can be rewritten as 




(28) 


Given a desired output trajectory and the desired output’s time 
derivatives, [C </(•). 0(0], the exact output tracking control law (see 
Sec. II. D) is found from Eq. (28) as 

unit) = B~ l IC rf (0 - A,C rf (f) - A 2 T)(t)] (29) 

With this control law, the inverse system becomes [from Eq. (28)] 
C (t) = CAO (30) 

r/(t) = A 4 T)(t) + A 3 C(t) + B 2 u(t) 

= [a 4 - B 2 B;'A 2 ]r 1 (t) + b 2 b;'icao ~ ^i< rf (t)] 

:= A n r)U) + B 2 B;'[CA‘) - MiC rf (0] (31) 

The problem is solved by finding a bounded solution to the internal 
dynamics (31). However, the bounded solution found through stable 
inversion is noncausal and could require a large preactuation time if 
the poles of the internal dynamics are unstable and lie close to the 
imaginary axis in the complex plane. For this particular example, 
there are two such complex conjugate poles near the imaginary axis, 
0.0425 ±4.3055*. We modify the exact tracking control law (29) to 
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Fig. 5 Forward velocity and yaw rate achieved by the inverse reference state trajectory, the desired value is zero: 
modification of the internal dynamics and , with modification. 


exact-tracking case without 




Fig. 6 Feedforward inputs: , without modification of internal dynamics and , with modification. 


shift these poles away from the imaginary axis to 2 ±4.3055*. This 
is described next. 


B. Modified Inverse System 

Following the approach described in Sec. II. C, we modify the 
internal dynamics by adding a term u(f) to the control law (29) to 
obtain 

Mff(0 = Sf'LCrfO) - AiC(0 - AjT7(f) + v(f)] (32) 


Substituting this control law into Eqs. (30) and (31), the modified 
inverse system is obtained as 



0 

(a>- b 2 b;'a ,) 



+ 




o 0 

(a 3 - B2B;'A t ) b 2 b;' 




where e ( (t) := C(0 - C AO- The poles of the inverse system can 
be moved to any desired location by using the control v(t) because 
(£, G v ) is controllable. However, such modifications, aimed at re- 
ducing preactuation time, will also lead to a loss of precision in 
output tracking. This tradeoff between the reduction of preactua- 
tion time and the loss of precision in tracking is illustrated through 
simulation. 

C. Simulation Results and Discussion 

Two sets of simulations were performed. First, stable inversion 
was applied to the original system, which leads to exact output 
tracking inverse input-state trajectories. Second, simulations were 
performed when the unstable poles of the inverse system are moved 
from 0.0425 ± 4.3055/ to 2 ± 4.3055/ for reducing the amount of 
preactuation time required. Further, the inverse system also has four 
poles at the origin, corresponding to four pure integrators for [e f (■)] 
dynamics, which were moved to — 1 , —2, —3, and —4 for stability 
of the numerical integration scheme. 

Figures 2 and 3 show the desired output trajectories for the lateral 
and vertical motions (corresponding to unit displacements in the 
two directions), while the forward velocity and yaw rate were to be 






Fig. 7 


Fig. 8 
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maintained at zero; the maneuver starts at timer = 0. Figures 4 and 5 

show the output trajectories achieved by the inverse state trajectory 
jc rc ,(-), which is to be used as a reference trajectory in the feedback 
scheme shown in Fig. 1. The corresponding feedforward inputs are 
shown in Figs. 6 and 7. Note here that the feedforward inputs are 
nonzero before the start of the maneuver, i.e., time l < 0, and hence 
preactuation is required. 

Figures 4 and 5 show that exact output tracking reference state 
trajectories can be found, even when the internal dynamics is un- 
stable, through the stable inversion approach. The stable inversion 
technique yields bounded solutions to the unstable internal dynam- 
ics, i.e., the pitch and roll motions are bounded, as shown in Fig. 8. 
However, the feedforward input found through exact inversion re- 
quires substantial preactuation time, as shown in Figs. 6 and 7, i.e., 
the preactuation remains nonzero for a significant time before the 
start of the maneuver at t =0. Figure 9 shows that about 30 s of 
preactuation is needed to apply the inverse of the original system for 
output tracking; in contrast, modification of the internal dynamics 
reduces the preactuation needed from 30 to 1 s (see Fig. 9). As seen 
in Figs. 4 and 5, the output trajectories are still tracked well by the 
modified inverse. Further, this substantial reduction in preactuation 
time is achieved with similar control efforts and with similar roll 
and pitch motions (see Figs. 6-8). Thus, the approach presented 
here allows a tradeoff between precision tracking and the amount ot 
preactuation that is acceptable. Future work will generalize the re- 
sults to nonlinear nonminimum phase systems with nonhyperbolic 
internal dynamics. 

IV. Conclusions 

A technique to achieve output tracking tor nonminimum phase 
linear systems with nonhyperbolic and near nonhyperbolic inter- 
nal dynamics was presented. This approach is an integration of 
the stable inversion technique that aims at exact tracking with 
the approximation approach that modifies the internal dynamics 
to achieve desirable performance. The method was applied to an 
example helicopter hover control problem to illustrate the effects 
of modifying the internal dynamics. It was shown that substantial 
reduction in preactuation time is possible by giving up some of the 
precision in tracking, thus making the stable inversion approach 
viable for practical application. 
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1 Introduction 


Precision output tracking controllers are needed to meet increasingly stringent performance requirements 
in applications like flexible structures, aircraft guidance, robotics, and manufacturing systems* While ex- 
act tracking of minimum phase systems is relatively easy to achieve through approaches like input-output 
linearization [1], output tracking of nonminimum phase systems tends to be more challenging due to fun- 
damental performance limitations on transient tracking performance [2]. This poor transient performance 
has been mitigated by using pre- actuation in the stable-inversion based approaches [3, 4]. However, the 
preactuation time (during which most of the preactuation control effort is required) depends on the unstable 
poles of the linearized internal dynamics - the preactuation time increases as the unstable poles approach the 
imaginary axis. In the limiting case, with the poles on the imaginary axis (nonhyperbolic internal dynamics), 
presently available inversion-based techniques fail because the preactuation time needed tends to become 
infinite. The present work extends previous results for linear systems in [5] to output tracking of nonlinear 
nonminimum phase systems, which have nonhyperbolic internal dynamics. 

Output tracking has a long history marked by the development of regulator theory for linear systems 
by Francis and Wonham [6] and the generalization to the nonlinear case by Byrnes and Isidori [7]. These 
approaches asymptotically track an output from a class of exosystem-generated outputs. Further, extensions 
to the Byrnes- Isidori regulator have been described in [8]. The main problem with the application of these 
techniques to the output tracking of nonlinear systems is computational. While the linear regulator is 
designed by solving a manageable set of linear equations, the nonlinear regulator design requires the nontrivial 
solution of a first order partial differential algebraic equation [9, 10]. In contrast, inversion-based approaches 
avoid this computational difficulty and trade it to solve the exact tracking problem for a single desired 
output trajectory rather than solve the asymptotic tracking for a class of outputs. Another problem with 
the regulator approach is that the exosystem states are often switched to describe the desired output - this 
leads to transient tracking-errors after the switching instants. Such switching caused transient errors can 
be avoided by using inversion-based approaches to output tracking [3, 11]. Thus, it is advantageous to use 
inversion-based output tracking when precision tracking of a particular output trajectory is required. 

Inversion, which is key to our approach, was restricted to causal inverses of minimum phase systems in 
the early works by Silverman and by Hirschom (e.g., [12, 13]) because these approaches lead to unbounded 
inverses in the nonminimum phase case. Di Benedetto and Lucibello [14] considered the inversion of time 
varying nonminimum phase systems with a choice of the system’s initial conditions. Rather than choose 
initial conditions, preactuation was used by noncausal stable inversion techniques developed in [3, 4, 15]. 
Such noncausal inverses, which require preactuation, have been successfully applied to the output tracking 
of flexible structures [16, 17], and aircraft and air traffic control [4, 18]. There is, however, a fundamental 
limitation to the presently available inversion techniques - they are only applicable if the internal dynamics is 
hyperbolic, and inversion-based output tracking has been a challenge for systems with nonhyperbolic internal 
dynamics. 

Although Huang [8] has proposed some sufficient conditions for developing a regulator for systems with 
non- hyperbolic internal dynamics, the regulator design remains computationally difficult. There are also 
several approximation based output tracking techniques, where the central philosophy is to replace the 
internal dynamics with a dynamics that provides satisfactory behavior, and then to develop the controller 
based on the altered system [19, 20, 21]. The techniques most relevant to this paper are developed by 
Gurumoorthy and Sanders [19], and by Gopalswamy and Hedrick [21] - output redefinition (or modification) 
is used in these to approximate the unstable internal dynamics with a stable system. Such approximation 
based approaches are integrated, in this paper, with stable-inversion based techniques to achieve inversion 
of linear systems with nonhyperbolic internal dynamics in [5]. However, the present technique does not use 
output modification to stabilize the internal dynamics, rather output modification is only used to remove 
the non-hyperbolicity. Additionally, for near nonhyperbolic systems, the present approach allows a tradeoff 
between the precision-tracking and the amount of pre-actuation-time that is needed in the control effort. 
This tradeoff between stable-inversion and approximation of the unacceptable internal-dynamics has been 
studied for helicopter-hover control in [5]. The present work extends the results for linear-system in [5] to 
nonlinear systems. 

We begin with a background on the stable-inversion based output tracking technique, and computational 
issues are presented in Section 3. The technique is applied to an example in Section 4, and conclusions are 


1 


in Section 5. 


2 The Stable Inversion problem 

2*1 Inversion- Based Output Tracking Scheme 

Here we describe how the inversion approach is used to develop output tracking controllers. Consider a 
system described by 

x(t) = f[x(t)] + g [*(<)] u(t) 

(1) 

y(t) = A [«(<)] 

where y(t) = [j/i(<)> 1/2 (<) , • • ->I/p(0] T * s the output, with the same number of inputs and outputs, i.e., 
«(0.»(0 f & p , and x(<) e ft" is the state. The functions /(•),$(•) and h( ) are assumed to be sufficiently 
smooth with /( 0) = 0 (i.e., x = 0 is an equilibrium point) and /i(0) = 0. 

Let yj(') be the desired output trajectory to be tracked. In the inversion-based approach we, first, find 
a nominal input-state trajectory, [«//(•), * re /( )] that satisfies the system equations 1 and yields the desired 
output exactly, i.e., 


Vd(t) 


f{x reJ {t)\ + g [z re /(f)] Uff(t) 
h t x re/(0] 


it 6 (— 00 , 00 ) 


( 2 ) 


and, second, we stabilize the exact-output yielding state trajectory, x re /( ), by using state feedback (see 
Figure 1). Thus x(t) -4 x reJ [t) and j/(<) y d (t) as t 00 and output tracking is achieved. It is noted that 
in this output tracking scheme, the reference state trajectory x ref ( ) and the feedforward input u f t( ) are 
computed off-line. 



Figure 1. The Control Scheme 

While stabilization of the reference state trajectory can be achieved through standard techniques [22] like 
state feedback of the form A[x(<) — x re j(t)], the main challenge is to find the inverse input-state trajectory 
{“//(■). *re/( )] - especially for systems with nonminimum phase dynamics. 

2.2 The Internal Dynamics 

In this subsection, it is shown that finding the inverse input-state trajectory is equivalent to finding bounded 
solutions to the system’s internal dynamics. 

Assumption 1 System (1) has a well defined vector relative degree, r := [ri, r 2 , . r p ]. 

The well-defined vector relative degree assumption enables the system equations to be rewritten, through a 
co-ordinate transformation 

Cit) 1 131 

9(0 J ’ (3) 

in the following form [1, 21] 


*(0 = r(*(i)) 


C(0 

»?(<) 


= r(C(0,9(0) 


2 











Cl (0 - ^C,Cl(0 + -^CaC2 (0 

6(0 = *i[C(0. »?(<)] + •alCW.rtOMO (4) 

*72(0 = *slC(0.9(0] + «4[C(0.*|(0]«(0 

where C represents the output along with its time derivatives, 



is a block-diagonal matrix 

^(i ^3j • • ■ 

with each block consisting of zeros except for ones on the super-diagonal, for example, A k isa(r fc -l)x (r* - 1) 
matrix of the form 

' 0 1 0 0 ... 0 ' 

0 0 1 0 ... 0 

i ! i : i : (6) 

0 0 0 0 ... 1 

_ 0 0 0 0 ... 0 _ 

(for all 1 < k < p). Aq 3 is a matrix whose elements are zeros except for elements on the (r k — l)-th row 
and fc-th column, which are ones (for all 1 < Jb < p). Further from Assumption (1), s 2 (-, ■) is invertible 
in a neighborhood of the origin, and since the origin is assumed to be an equilibrium point, we also have 
(0, 0) = 0, s 3 (0,0) = 0. 

Note that the desired C() is known when the desired output trajectory y d ( ) and its time derivatives are 

specified. This desired C() is defined as &( )• If exact output tracking is achieved (i.e., if £(<) = Cd{t)) then 

the control law for maintaining exact tracking can be written as, from equation (4), 

u (0 = [•*[&(<), *?(0]]" 1 [6,*(0 - si [Cf(<)» *7(0]] (7) 

which results in state-equations of the form 

c (0 = 6(0 ( 8 ) 

*7(0 = s 3 [c(0.*7(0] + «4[C(0.*7(0M0 

= s 3 [C(0, *7(0] + «4[C(0. *7(0] MC<(0. *?(0)]“ 1 [6,*(0 - *i[Crf(0. *7(0]] 

(9) 


3 



This is the inverse system and equation (9) is referred to as the internal dynamics. Solving the internal 
dynamics is key to finding the inverse input state trajectories. If a bounded solution, %(•), to the internal 
dynamics (9) can be found then the feedforward input can be found through equation (7) as 

= [«2(Cl(<)> Vd(t))] 1 [C2,d(<) ~ «l(Cd(<)> *?<*(<))] (10) 

and the reference trajectory can be found as 


= n«o.wcn [«$]. 


( 11 ) 


Thus, finding a bounded solution, %(•), to the internal dynamics (Equation 9) is key to finding the inverse 
(bounded) input-state trajectories (Equations 10 and 11) which is needed to implement the the inversion- 
based output-tracking scheme shown in Figure 1. 


2.3 Modified Internal Dynamics 

Standard inversion schemes [12, 13] that integrate (forward in time) the internal dynamics (9) lead to un- 
bounded solutions if the origin of the internal dynamics is unstable (nonminimum phase systems). Noncausal 
inversion (e.g., [3]) leads to bounded but noncausal solution to the internal dynamics. While significant im- 
provement in output tracking performance is possible, such stable-inversion techniques are not applicable to 
systems with nonhyperbolic internal dynamics. In this subsection a compromise between stable inversion and 
approximation based inversion schemes is proposed. The key is to modify the internal dynamics by giving 
up exact output tracking - enough to remove the nonhyperbolicity, and then to apply stable-inversion. The 
difference between the proposed technique and other approximate techniques is that the internal dynamics 

is perturbed only to remove the nonhyperbolicity, and not to stabilize the internal dynamics as in other 
approximation schemes [19, 21]. 

To modify the inverse system an extra term, v{t), is added to the control law (7) as follows 

u(t) = [s 2 [C(t), »?(<)]] 1 [c2,d(0 - *l[C(*)« *?(*)] + »(*)] (12) 

With this control law the system equation (4) becomes (note that it is not required that exact tracking is 
achieved, i.e., C(’) = Cd(*) is not required) 

Ci(0 = ^CiCi(0 4- j4 fa C 2 (<) 

Ca(f) = C2,d{t) + »(<) 

•3[CW,9(0I + «4[((f)>9(<)H*3[((f)>’ri*)]r 1 [C 2 .rf(<) -«i[C(*)>*K*)] + v(t)] 

For ease in notation, we define the tracking error, C((t), as 

e U) := f «C.(0 1 ._ f Ci(<) -Cm(0 1 

fU l«c.(0 J"IC 2 W-CmW J 

and rewrite Equation (13) as 

*Ci W = ^Ci e fi(0 +-^C3 e Ca(0 

= »(*) 

ri(t) = «3[e<(<) + &(<), 17(f)] + 

s 4ec(0 + Cd(t), >?(0] [« 2 [e f (0 + 0(t), *?(t)]] _1 [C 2lrf (0 - si[e c (<) + &(<), r/(t)] + «(<)] 


(13) 


» 7(0 = 


4 


(14) 



where 

Y„(t) := 

Next, the nonhyperbolicity of the modified internal dynamics (14) is removed by appropriately choosing 
v(-). We begin with the following assumption. 

Assumption 2 System (1) is controllable in the first approximation [ 1 ]. 

The above assumption implies that the modified internal dynamics is also controllable in the first approxi- 
mation since the difference between the original system (1) and the modified internal dynamics (14) is only 
a co-ordinate transformation and a static state-feedback (see [21] for a similar argument used for output 
redefinition). Next, a feedback of the form 

-«)=*■[;$] us) 

is chosen such that the modified inverse system is hyperbolic - i.e., all poles on the imaginary axis are 
moved. Note that this change to an hyperbolic system can be achieved through arbitrarily small F since 
nonhyperbolicity is not a structurally stable property. With this control law Equation (14) becomes 


Ut) 

Cj A*) . 




e f3 (t) = F 


e ( (i) 

L m 


ri(t) = s (e c (<), r)(t), Y d (t),F 
which is re-written in a simplified form as 


«?(<) 


D 


’ «c(*) " 
. *»(*) . 


s( e C (<).»?(<). >*(<))• 


Next, stable inversion of the modified inverse system (17) is carried out [3]. 


(16) 


(17) 


3 Computation of the Inverse 

This section discusses the computation of the inverse for the hyperbolic, modified, inverse-system. First, an 
iterative algorithm is presented - one of the steps involves finding bounded solutions to a linear (unstable) 
system. Second, the explicit technique to find bounded solutions is presented, and the amount of preactuation 
required for implementing the inversion-based controller is discussed. We begin with the algorithm to find 
bounded solutions to the modified internal dynamics [3]. 


3.1 Iterative Algorithm to find Inverse 


• Step 1 

Rewrite the modified inverse (17) as 


£ [ MO 

dt L rj(t) 


S 


' e c (t) 

. »?(0 


{'(ecM.lW.lWM-S’ 



(18) 


where the first term on the right hand side (r.h.s.) is the linearization of s(-, *, *) with respect to the 
first two variables, e^( ) and q(-), and the second term on the r.h.s. represents a perturbation. This 
motivates the following iterative solution of the internal dynamics. 


• Step 2 

At each iteration in the following scheme, the bounded solution of a linearized system is to be found 
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dt [ V(t) L +1 - s [ rn ]„ +1 + { s ( c (^)W.^W,y rf (0)-5[ e <W ] J 


where 

[ e c (0 1 . = [ e CN+ i(t) 1 

l i(0 Jjv+ 1 ' l m+i(t) J 

and N = 1,2,3.... 


(19) 

( 20 ) 


3.2 Bounded Solution to Unstable Linear System 

In the abow iterations, solving equation (19) implies finding a bounded solution to a linear, hyperbolic (but 
potentially unstable) system - this is described next. 

We begin by decoupling the linear system (19) into stable (z.) and unstable (z u ) subsystems. Since the 
modified internal dynamics is hyperbolic, there exits a decoupling transformation V such that equation (19) 
can be re-written as v ' 

*(«.w+i)(0 = SuZ(u,n+i) (0 +G u YXr(2) 

where 


*JV+i(<) := Z (».^+1)(0 ;= u [ e (r>,N+l)(t) 1 

. z (u,N + l)(<) J [ *?7V+l(<) J 

MO : = »7Ar(t), K rf (<» -5 | 1 


An approach to find bounded solutions is to enforce the boundary conditions that Z(,,jv+i)(-°o) = 0 and 

Z{u j N a l ■ r Thl , S leads t0 unic l ue bounded solutions by flowing the stable subsystem forward in time 
and flowing the unstable system backward in time - this yields 

*(..w+i)W = I-oo eS,(t ~ T) G.Y N (r)dr We (- 00 , 00 ), 

( 21 ) 

*K"+i )(0 = fL^^GuYN^dr We (-00,00). 

Next, a change of co-ordinates yields the bounded solution to (19) as 


' e ( {t) ' 

. l(0 L 


= V 


-1 z (.,/v+i)(<) 

. z («.w+i)(0 


3.3 Convergence of Iterative Algorithm 

hnnn f H^ OW T g t stat “ that - 33 N °o, the solutions of the above iterative algorithm converge to a 

bounded solution of the modified internal dynamics (17). 

Theorem Let s(-, •, •) and its linearization 5 satisfy the following Lipshitz like condition 


5 A ’ lll [*]~[wl ll “ 


+k 2 \\y 1 -y 2 \ 
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Then, provided K x, K 2 and || Y^(-) 
internal dynamics (17), i.e, 


are small, the iteration scheme converges to a solution to the modified 


’ e c " 

O 

i — 

t 

. n . 

N L Vd J 


as TV — > oo, and 


Proof 

See [3, 4]. 


e (C ,*) 

Vd 


satisfies the modified internal dynamics. 


□ 


Thus, stable inversion technique is applied after removing the nonhyperbolicity in the internal dynamics. 

This completes the inversion- technique for nonminimum phase systems with nonhyperbolic internal dy- 
namics. To summarize, the reference state trajectory is found as (from Equation 11) 

x„,{t) = T[C,(*).%(<)] [ jjjj ] , 

where 

C d{t) := Cd(<) + c (C,<<)(0 

and the feedforward input, «//(•), is found from equation (12) and equation (15) as 

«//(*)= [•a[6W,«wW]]' 1 m + F [ e % d (j) ) ]] (24) 

This inverse, [«//(•)> x rc /(*)]» 18 use d * n fh e control scheme shown in Figure 1 to obtain output tracking. 
3.4 Preactuation Time 

Stable-inversion techniques overcome fundamental limitations on transient tracking performance of non- 
minimum phase systems [2] by using preactuation. However, the preactuation time (i.e., when most of the 
preactuation effort is required) tends to be unacceptably large if the unstable poles of the linearized, modified 
internal dynamics are close to the imaginary axis - this dependence is established in the following Lemma. 

Lemma 

Let 


• all the unstable poles of linearized, modified internal dynamics (eigenvalues of S u ) lie to the right, in 
the complex plane, of the line Real(s) = a for some positive a, and 

• the support of Vd(-) lie in [<o, oo) for some to. 


Then there exists a positive scalar, M, such that the bounded solution to the internal 
the Theorem) satisfies 


««,<*)(*) 

Vd{t) 




dynamics (defined by 


for all time, f, before the start of the maneuver at to. 


Proof Since the maneuver starts at < 0 , any solution to the modified internal dynamics (17) satisfies the 
autonomous equation, 

= « MO, >?(*), 0). (25) 

for all t < t 0 . Further, any bounded solution to the autonomous equation must lie on the unstable manifold 
before the start of the maneuver. The rate of convergence to zero as time tends to —oo, of solutions that 
lie on the unstable manifold of the nonlinear modified inverse system, directly depends on the location of 
poles of the linearized dynamics. In particular, the rate of convergence depends on the unstable poles of 


e ( (<) 
. »)(*) 


7 



the linearization (which are the eigenvalues of S u ). The existence of a positive scalar M that satisfies the 

statement of the lemma follows from the saddle-point property (see [23] Theorem 6.1, and [24] Theorem 
j. «/ . y l . 


The present technique also provides a way to reduce the preactuation time for systems with near non- 
hyperbolic internal dynamics. The Lemma states that the desired state-trajectory exponentially ends to zero 
as we go back in time before the start of the maneuver at t 0 . Then the continuity of the input with respect 
to the state (smoothness of /, g and h, and the well defined relative degree assumption) implies that the 
preactuation input also tends to zero exponentially. The rate at which the preactuation becomes zero can 
be increased by moving the unstable poles of the linearized, modified internal dynamics (i.e., the eigenvalues 
ot b„) away from the imaginary axis - by appropriately choosing F in equation (15). This reduction in 
preactuation-effort is obtained at the expense of exact output tracking (see [5] for a linear example). 

4 Example 

Here, the inversion-technique is applied to an example two-cart and pendulum system shown in Figure 
2. The inverted pendulum on a cart has been well studied in literature (see, for example, [19]) and has 
nonminimum phase dynamics - the internal dynamics is hyperbolic. An extra cart is added here which 
introduces nonhyperbolicity in the internal dynamics. The input to the system is the applied force Fit) 
and the output is the position, *i(0, of the cart carrying the inverted pendulum (see Figure 2). The equation 
ot motion for the system can be obtained as 


(M + m)ii(t) + m/ cos 0(f) 1 9(f) = 

ml cos 0(f) a (f ) + ml 2 0(f) = 

Mx 2 (t) = 

which can be rewritten in state-space form as 


F(t) + m/ 0 2 (f) sin 0 (f) - K ( Xl {t) - x 2 (t)) 
mgl sin 0(f) 

-K (x 2 (t) - *!(*)) 


Ci (0 = C 2 (0 

— t(>?i) +fr?2(0 sini7i(t) — A/m (Ci (<)— 173(f)) cos 171(f) sin 171(f)] 

171 (<) = 17a (<) J 

K (0 = {K/M) (Ci ( 0 - 17 ,( 0 ) 

73(f) = 174(f) 

^ 4 W = [-^(O 2 sin 73(<) cos 173(f) 

+ £l{(M + m)g sin 73(f) - F(t) cos 73(f) + K (Ci(f) - 71(f)) cos 73(f)}] 
where Ci := *i, C2 := *1, 7i := x 2 , 72 := x'2, 73 := 0, and 74 := 0, 


7(73(0) : = M/m + [sin 73(f)] 2 



Figure 2. Example: Two Carts and Inverted Pendulum 
Given the desired output trajectory profile shown in Figure 3, the input that maintains exact tracking (i.e., 
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which maintains £(t) = 0(0) obtained from equation (27) as 

F(t) = Tn-y{r) 3 )x lid (t) - m/[» 74 (f)] 2 sin ^(t) + K [Ci(0 - »?i(t)] + m^fcos r? 3 (*)] sin r? 3 (Z) 




Figure 3. Desired Output Profile for x\ 

With this exact tracking control law, the internal dynamics (represented by rj), is given by 


m(t) = V2 (<) 

m(t) = (K/M)(x lti (t)- m (t)) 

*73 (t) = *?-*(<) 

^4(<) = 9/1 sin»73(t) — (l/Ocosifa^xi^t) 

The linearization of the internal dynamics (28) is 



’ m(t) ' 


0 100 ' 


Vi(t) ' 


0 o' 

d 

m(t) 


-K/M 000 


*7a(t) 

1 

K/M 0 

dt 

m(t) 


0 001 


»?3(0 

T 

0 0 


. n<(t) . 


0 0 g/l 0 


. *•(*) . 


0 -1/Z 


*m(0 


(29) 


Note that the linearization has two poles at ±y/—K/M on the imaginary axis (in the complex plane) which 
corresponds to the cart dy nam ics (£ 2 , £ 2 ) w ^h £1 fixed; this corresponds to a spring-mass system. The 
other two poles are at ±y/gjl which correspond to the linearization of the inverted pendulum dynamics 
{0,9). The two poles on the imaginary axis lead to nonhyperbolic behavior and stable-inversion techniques 
fail - this corresponds to the case which requires infinite pre-actuation. In contrast, by modifying the desired 
trajectory, the internal dynamics can be approximated by a hyperbolic system. This modification is achieved 
by adding an extra term v(-) to the control as follows 


u //(0 = **(0 = m 7(*?s) [*m( 0 + w(0] “ ™*[»/4(<)] 2 sin t7 3 (0 

+# [Ci(0 ~ *?i(<)] + m P[co8ife(<)] sin Tfc(t) 


(30) 
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The modified inverse system becomes 



«C. (<) 

— e Ca(0 


« C a (<) 

= v(t) 


m(t) 

= m (*) 



= -K/Mtji + K/M + e fl (f)] 


%(<) 

= »74(<) 


>M0 

= 5 r// sin 77 3 (<) - 1 // cos 173 (f) [i 1 >d (t)+ v (f)] 

where 



(31) 


’ e C.(<) " 

._ r ci(o - *i,d(<) 1 

l '(A*) . 

' L Ca(0 -*!.-(<) J 


C c(0 : = [ 

The additional input, v, is chosen ft; = F\eJ 

r ’ ’ v ■/ J / uv me liuilll^pcruoiici 

lor example, by pole-placement algorithms. Simulation results are presented next 
were chosen as K = 10, M = 1, / = 9.8, g = 9.8 and the F used in simulations is 


to remove the nonhyperbolicity. This can be achieved, 

The system parameters 


F ~ [— 4.52e - 2 - 3.04e - 1 he - 4 1.5e - 3 


UJ. 


This F removes the nonhyperbolicity of the internal dynamics and stable inversion of the modified inverse 
system is carried out using the algorithm in Section 3. Simulation results are presented below Figure 4 
shows the desired output trajectory, and the redefined output trajectory. The internal dynamics ( x 2 ,0 ) 

s own in Figure 5- Note that the nonhyperbolicity is circumvented and stable inversion is achieved with 
relatively minor modification of the output (see Figure 4). 



Figure 4. Error in Output Tracking: Solid line is desired output and dotted line is the redefined output. 




Figure 5. Internal Dynamics 
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5 Conclusion 


A technique to achieve output tracking for nonminimum phase nonlinear systems with nonhyperbolic internal 
dynamics was presented. The approach integrated stable inversion techniques (that achieve exact tracking) 
with approximation approaches (that modify the internal dynamics) to remove the nonhyperbolicity of the 
internal dynamics. It was shown that, by giving up some of the precision in tracking, it is possible to achieve 
stable inversion of nonlinear nonminimum phase systems with nonhyperbolic internal dynamics. 
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Abstract 


When a fixed regulator is used to stabilize a desired state trar 
jectory (guidance law), large initial tracking errors can lead to input 
saturation, which can result in performance deterioration. A method 
to modify the guidance law for recovering state-trajectory tracking 
(without violating input and state constraints) is presented. Although 
it may be feasible to find such a satisfactory recovery guidance maneu- 
ver for a given initial tracking error, online development of recovery 
guidance maneuvers may not be computationally tractable. A tech- 
nique is developed to use precomputed recovery guidance maneuvers 
(for a finite set of initial tracking errors) to generate recovery guidance 
maneuvers for other initial errors. The technique is applied to an il- 
lustrative example with input-magnitude-limits and input-rate-limits, 
and simulation results are presented. 


1 Introduction 

Inversion of system dynamics can be used for precision output tracking con- 
trol, for example, in aircraft control [1,2], and in air traffic control (ATC) [3]. 
For example, in automated flight management systems, tracking of an ac- 
cepted clearance (flight plan cleared by the ATC) can be achieved by the 
following. First, the clearance is converted to an executable reference flight 
path (desired output trajectory [4]). Second, this flight path is converted 
into a guidance law (exact output-tracking input-state trajectory) found, for 
example, by using an inversion based approach [5, 6]. Third, flight path 
tracking is achieved by stabilizing the guidance trajectory by using a tra- 
jectory regulator (see Figure 1). However, relatively large tracking-errors 
(or a large external disturbance, that can be modeled as a tracking error) 
can lead to saturation of the inputs and can lead to the violation of state- 
constraints. This work addresses the issue of modifying the guidance law to 
recover output-tracking without violating input and state constraints. The 
recovery guidance problem is addressed in the framework of general linear 
systems and an example is provided to illustrate the technique. 

The Guidance Scheme: The guidance scheme, studied in this paper, is 
shown in Figure 1, where the state-trajectory regulator, K, is assumed to be 
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given. The guidance problem, for a prescribed output trajectory, y d (A, is to 
find a reference state trajectory, x ref (•), and a feedforward input trajectory, 
tiff (•), that achieve exact-output-tracking which can be accomplished by the 
inversion of the system dynamics (see, for example, [1, 3, 5, 7]). Note that 

these input-state trajectories may be precomputed for a given set of desired 
output trajectories. 



Figure 1. Control Scheme 

V L 0 '*?° n ° f AC L tuator and State Constraints: A significant problem 
with he approach is that relatively large initial tracking-errors can lead to 
ac uator saturation resulting m performance degradation. Additionally, con- 
straints on the state may also be violated. One approach, to solve such 
saturation problems, is to redesign the regulator ( K in Figure 1) for dif- 
ferent magnitudes of the initial errors (see, for example, [8]), or to design 
ppropriate software limits (see, for example, [9] and the references therein) 
Another approach is to develop a nonlinear feedback that avoids satura,- 

_ n Jr 1' The P resent work develops an alternate approach, that doesn’t 
modify the regulator, per se, but effectively bypasses it through recovery 
guidance maneuvers that modify the primary guidance law. Such an ap- 
proach, that doesn t modify the regulator, is important to systems where 
he regulator is not easily accessible to modifications. For example, in the 
design of flight management systems, modifications of regulator can require 
extenswe testing and re-certification, while the proposed open-loop recovery 
pi ance can be (relatively) easily incorporated into the software. Simi- 
lar use of less-aggressive reference inputs to avoid saturation can be found 
using receding horizon strategies [11] (also see references therein). These 
techniques modify the command signal to avoid actuator constraints. Our 
approach uses a similar idea to avoid saturation caused by large deviations 
rom a desired trajectory - the desired trajectory is recovered, however, the 
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recovery maneuvers are chosen to be less aggressive. A key result is the de- 
velopment of a methodology that doesn’t require online computation of the 
recovery guidance maneuvers - rather, in the spirit of the work by Mayne 
and Schroeder [10], the recovery guidance maneuver is generated as the linear 
combination of precomputed maneuvers. 

We begin with a description of the guidance scheme in Section 2, followed 
by the development of recovery guidance maneuvers from precomputed ma- 
neuvers in Section 3. An optimal approach to develop recovery guidance 
maneuvers, for a given initial tracking error, is presented in Section 4, fol- 
lowed by an illustrative example and simulation results in Section 5. Our 
conclusions axe in Section 6. 


2 Primary Guidance Scheme 


Let the system be described by 


x(t) = A x(t) + B u(t ) 
y{t) = C x(i) 


( 1 ) 


where x(t) € ft” is the state, u(t) € ft 9 is the input and y(t) € ft' is the 
output. Additionally, let a state feedback K be given such that the closed 
loop system is stable, i.e., A+BK is Hurwitz. In all the following discussions, 
the feedback, K, is kept constant. 

Given a desired output trajectory the primary guidance scheme 

(see Figure 1) finds a nominal input-state trajectory, [«ff (-),x re f (•)], that 
satisfies the system equations (1) and yields the desired output exactly, i.e., 


SrefW = A x re f (t) +flu ff (f) 
yd(t) = Cx Tef (t) 


V< € (— 00 , 00 ) 


( 2 ) 


Next, the exact-output yielding state trajectory, x ref (•), is stabilized by 
using state feedback (see Figure 1). The control law is 


u(<) = (t) + K [x(t) - x ref (<)] . 


With this control law, the dynamics of the tracking error, 


e(t) := x(t) - x ref (<), 


( 3 ) 


4 


( 4 ) 


is obtained from equations (1) and (2) as 

e(t) = (A + BK) e(t) . 

Since X + BK is Hurwitz, i(i) -► Ifef (() and y(t) yj(() „ ( ^ 

and therefore, output tracking is achieved. It is noted that in this output 
tracking scheme the reference state trajectory x ref (•) and the feedforward 
input u ff (•) can be computed off-line. It is also typical for the desired output 
trajectory to be a composition of several predetermined sub-trajectories and 
the primary guidance scheme may concatenate several precomputed guidance 
laws These primary guidance laws could be found using inversion of the 
plant dynamics (for systems with same number of inputs as outputs see, 
e.g., [«J, o, (, 1JJ, and for actuator-redundant systems see [13]). 

Problem with the Guidance Scheme: A critical problem with the 

above guidance scheme is that large errors between the reference state- 
trajectory and the actual system state, at the beginning of a maneuver, can 
ead to actuator saturation and to substantially deteriorated performance. 
Note that the input-saturation problem is accentuated if a relatively high 
gam regulator, K is used - which may be necessary to achieve high perfor- 
mance for relatively small tracking errors. The goal of the recovery-guidance 

— :V, S t0 m ° dlfy the Primary K uidance law (reference-state trajectory) 
such that the system states can be brought close to the reference state trajec- 

tory (i.e, output-tracking is recovered) without saturating the actuators and 
without violating state constraints. Recovery guidance from large external 
per urbations can also be studied under this framework provided the per- 
turbation is modeled as an initial tracking-error, that triggers the recovery 
guidance generator. y 


3 Trajectory Recovery Guidance Scheme 

The recovery guidance scheme aims to maneuver the system without violat- 
mg input and state constraints. The approach is to modify the reference state 

fi«t?on r z t0 7; dsatUra ‘ io ° of the “*■«*<*• (*e Figure 2). This modi- 
tion, x d (•), 1S essentially open-loop, however, it is assumed that the 

r :r rySUldanCC trajC j tory generator has access to the initial tracking-< 
(when the recovery guidance is initiated). 


-error 
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Figure 2. The Recovery Guidance Scheme 

With the modified state-trajectory the control law given by equation (3) 
becomes (see Figure 2) 

U(t) = U ff ( t ) + Ufb (<) 

= (t) +K (x{t) - x ref (t)) + Kx mod (t) (5) 

= + Ke(t) +Kx mod (t) 

where 

u fb (0(0 = K e(t) + Kx mod (t) (6) 

and the error equation (4) becomes 

e(() = (A + BK)e(t) +BKx moi (t). (7) 

3.1 Use of Convexity to Generate Recovery-Maneuvers 

The key idea is to pre-compute the trajectory modification for a set of initial 
conditions (from a set X), and then use these pre-computed modifications 
for other initial-conditions. This is summarized in the following proposition 
that uses the convexity argument due to Mayne and Schroeder [10]. The 
proposition states that if satisfactory recovery guidance is known for a set 
of initial conditions, X , then satisfactory recovery guidance maneuvers can 
be obtained for any initial conditions in the convex hull of X, provided the 
following assumption holds. 

Assumption 1 The region of acceptable states in 5R W and the region of ac- 
ceptable inputs in are both convex regions that contain the origin. 
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Given a positive integer p let 

A P — |a € | A m > 0 Vm € (l,2...p), and £A to = i|. (8) 

ro=l J 

where the subscript indicates the component of a vector. 

Proposition 1 For each initial condition, x m (0) e X, let x m ,(■) be a 
trajectory-modification, that enables guidance-recovery while spying the 
state and input constraints. Let s(0) be an initial condition in the convex 
null oj A and A x ( 0 ) € A p for some p, such that 

*(0) = 22 A I*(o),m] * m (0) 

m= 1 

Zi7fi!«Ln perscnpt im ° tes ekmmts 0/0 Kqumce ' ncn ’ the ,raiectorv 

V 

®mod (0 : = 22 A Mo)H Xmod (0 , 

m=r 1 

i lnIrtM7r'’ eTV3 '‘ iia " CC UW ’ U ’’ constmints mi statc extremis 

1h Th ?r r ° r d J' namicS , ^ Uation < 7 » is «near in ‘he initial condition, 

tions of ( 'L S r* C(0) “ d Imod H *“ Une “ “ mbi ° a - 

.... • f ^ X mod (’) Wlt k same weights for each m € (1, 2, ... p) 

the linearity of the error dynamics yields ' 

e(<) = £ A Wo) , m | e"(t) . 

m=l 

Here, e m (.) is the solution to the error dynamics corresponding to the tra- 
jectory modification x™ od (•) and initial condition e ro (0). 

ditiof.-mt “ f:r' Ul T t0 “* m0difi ' d sUte with initial con- 

of the error yields x m (*, = 
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imply that 


x (*) == x ref (0 + e W 

5Zm=l -^[xfOj.m] ®ref (0 *h Sm=l <^[x(0),m] (9) 

= Ero=l ^[x(0),m] X m (t) 

Thus, the convex hull of x m (t) forms a tube (as time varies) - Assumption 1 
implies that the tube is in the acceptable region of the state space and hence 
cc(-), which lies in this tube, is also acceptable. 

Similarly, linearity of the modified input in e(-) and x mo< j (•) (see equa- 
tion (5)) yields 

“(0 : = “ff (0 + Ke ( t ) + Kx mod (0 

= Si=l ^[x(0),m] tig- (t) -f £m=l ^(x(0),m] C m (t) + K J2m=l ^[x(0),m] X mod (0 
= Em=l ^[x(0),m] tt m (t) 

(10) 

where txjy (•) is the modified input for the initial condition x m (0). Thus the 
convex hull of uj^ (t) also forms a tube (as time varies) - Assumption 1 implies 
that the tube is in the acceptable region of the input space and hence Uff (•) 
which lies in this tube is also acceptable. 

□ 


Remark 1 The above proposition is also valid for time-varying systems. 

3.2 Decoupling Guidance Recovery from Primary Guid- 
ance 

In the above approach, the guidance modification, x mod (•), might depend 
on the particular maneuver being considered - thus, for each maneuver, the 
x mod (') to be stored is different even if the initial tracking-error e m (0) re- 
mains the same. We propose a method to trade-off the storage require- 
ments with performance — to remove the dependence of guidance modifica- 
tion, x mod (•), from the primary guidance maneuver, [uff (•), x re f (•)]. 
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Ncrte that bounds on the input-components can be decoupled into bounds 
on the feedforward and feedback by using the triangle inequality 

M*)l < | u (//,.)(0| + \K (e,(<) + x (roo *, ■,(*)) | 

; = |“(//.o(0| + |“(/6.o(0| Vi € (1,2, .. .q). ( ^ 

The primary guidance can be designed to ensure that the feedforward in- 
put components, |ti ( / /t0 (<)|, are within bounds and the recovery guidance 
design can be aimed at limiting the feedback components, |u (/i ,)(*)!. This 
distribution of control authority allows the bounds on feedback-input to be 

independent of the feedforward input, which could depend on the particular 
maneuver. 

Similarly bounds on the state-components can also be decoupled into 
bounds on the components of tbe error, |ei(<)|, and bounds on maneuver- 
dependent reference state trajectory components, |x (re/tt) (<)| 

M<)l < |*(re/.,)(<)| +|(x,(f)-X(re /l0 (<))| 

I I ( 12 ) 

: = P<~/.o(<)| +M<)| Vi € (1,2,. ..n). 

Again, the primary guidance can be designed to ensure that \x (refi dt)\ is 
wi hm bounds and the recovery guidance design can be aimed ^ limiting 
|e,(t)|. This decoupling is formalized by the following proposition. 

Assumption 2 The region of acceptable errors in and the region of 
acceptable feedback inputs in W are convex regions that contain the origin. 1 

Proposition 2 For any initial error, e m (0) £ E, let (.) be a trajectory- 
modification, that enables guidance-recovery and satisfies the error and feedback- 

'of lin'd. \ am a\ ^ 9iVtn an iniUal COndition > e (°)» ** convex hull 

OJ t, and A c(0 ) € A p for some p, such that 


<K°) = E -Wh c"(0) , 


m= 1 


the trajectory modification 



is a valid recovery guidance law i.e., the input and state constraints are sat- 
isfied. 

Proof This follows from arguments similar to those for the proof of Propo- 
sition 1 and inequalities (11) and (12). □ 

Note that the proposition allows the design of the trajectory modifications 
that are only dependent on the initial error. Thus, x mcK j need not depend 
on the particular primary guidance law - note that this decoupling trades off 
performance for reduced-storage. 

4 Recovery Guidance Generation 

Recovery for a single initial condition: Given a specific initial con- 

dition, any algorithm may be used to find a particular recovery guidance 
maneuver. To illustrate the method, in the following, an optimal control 
formulation is used to design the recovery maneuvers. 

The tradeoff between the need to bound the error and the need to bound 
the feedback input can be posed as an optimization problem - as the mini- 
mization of (over all inputs, x mod (•), to the error-dynamics (7)) 

3 : = -/o 00 {* T (t) Qe e(t) + (t) R lift («) + x£ od (t) Q mod x mod (t)} dt 

= So°° { x mod <*> C KTRK + Qmod ) *mod W + 2* T (t) (k t Rk) x mod (t) 
+ e T (t) (K T RK +Q e )e(t)} dt 

So { x mod St x mod (*) 2^ r (t) S * moc | (0 + c T (t) Q e(t)| dt . 

(13) 

where Q e is the weighting factor on the error, and R is the weighting factor 
on the feedback input. This is the standard optimal control problem for the 
modified error dynamics equation (7), with x mod (•) as the input 

e(t) = (A + BK) e(t) + BKx mod (t) 

The optimal trajectory modification law is then obtained as (see, for example, 
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[14] for the development of the standard optimal control law and conditions 
on the weighting matrices) 


x mod (0 — Ke{t) (14) 

where 

k = -R- 1 ((BK) t P +s) 

and P is the solution to the algebraic Riccati equation 

P(A+BK) +{A+BK) t P -(P(BK)+S)R-'((BK) t P+S t ) +Q = 0 

Substituting the modification law into the error dynamics equation (7) and 
solving the resulting equation yields an open-loop trajectory modification 
tnat depends only on the initial error 


x mod (0 = exp [(A +BK + B K K){t)]e{ti) 

:= exp[(A + BK e ){t)]e(Q) ( 15 ) 

For each initial error, e(0), the weightings (Q e , R, Q mod ) used in the above 
optimization cost-criterion can be different, however, only the resulting K 
m equation (15) needs to be stored for each of the initial conditions. 

Note, again, that other algorithms may be used to obtain suitable recovery 
guidance laws for prespecified initial conditions in E. Alternate approaches 
to finding such guidance modification, x mod (•), include the following. 

• The weighting factors in the above cost function Q ei R Q . ran be 
time-varying [14]. ’ 


• The optimization problem can also be posed in the frequency domain 
and the weighting factors can also be made frequency-dependent to 
account for band-width limitation of the individual actuators [15] 


• Another approach is to achieve zero tracking-error in finite time [14]. 


Next, we discuss using these precomputed recovery guidance laws 
recovery guidance for other initial conditions. 


to generate 
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Recovery Guidance for initial error in Convex Hull of E : In 

general, given an initial error and a set initial-errors, E, for which the recovery 
guidance maneuvers are known, an initial error in the convex hull of E may 
be written as the convex combination of elements of E 

e(0) = E*" e ”(0) (16) 

m 

where e m (0) € E. This representation may not be unique, however, each rep- 
resentation leads to an acceptable recovery guidance maneuver (by Proposi- 
tion 2). 

Remark 2 The particular choice of the convex combination e m (0) can be 
optimized by using additional criterion - for example, to maximize the con- 
vergence rate of the error dynamics. Note that the resulting error dynamics, 
e( ), will converge atleast as fast as the slowest e m (-) that have nonzero coef- 
ficients in eguation (16) — which gives a lower bound to the convergence-rate. 
Therefore the coefficients, \ m , of the convex combination in equation (16) 
may be chosen such that lower-bound of the convergence-rate is maximized. 

We present one technique to find a recovery guidance law by appropriately 
defining the set of initial errors, E , for which the recovery guidance maneuver 
is precomputed. Let the set of acceptable errors, V[a, /?)> be defined by upper 
and lower bounds on the components of the error vector, i.e., let a 6 9?” and 
P € 9? n be given such that 


a, < pi , V* € (1,2, ...n) (17) 

and any acceptable initial-error, e(0) € V( a ,p), satisfies 

< c, < pi , Vi € (1,2, ...n) . (18) 

We define the corner points of the set of acceptable errors, V (Qi/J) , as the set of 
initial errors, E, for which the recovery guidance maneuvers are precomputed 
where ’ 


E := {e | e, = a, or e, =/?, , Vi € (1,2,. ..n) }. 

Let {e m } m=1 be an enumeration of E. Then any initial error e(0) 
be written as 

e (0) = £ A m e" 

m=l 


€ E cam 
(19) 
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where 


with 


x m = IJ 7i( e «» e, m ) 


»=1 


7.(e„ «T) == if C = 


•= e » ~ a l if f m 
A-a. 11 W 


a. 

ft 


( 20 ) 


( 21 ) 


The weighting, A TO , in equation (19) is used to generate the recovery guidance 
maneuver as discussed in the Proposition 2. 


Remark 3 The performance of the recovery guidance maneuvers can be im- 
proved by decomposing the set of initial errors into smaller sets, V {a}> 0i) , j € 
(1,2 and developing recovery guidance maneuvers for each of the 
smaller sets. This can lead to increased performance, however, it also re- 
quires an increase in storage (to store precomputed recovery maneuvers for 
the comer points of each of the smaller sets). 


5 Example 


System: Consider the motion of a point mass (for example, the linearized 
single-axis dynamics of an aircraft, see Meyer and Smith [6]) 


Xl(<) = x 2 (t) 
*2 (<) = u(t) 

y(t) = xi(t ) 


( 22 ) 


where y,y,y (i.e., x\, 12 , 12 ) represent the generalized position, velocity and 
acceleration, respectively. Additionally (as is typical in aircraft control) we 
consider the case when the generalized force u(t) is not directly accessible. 
We assume that the servo-actuator, that generates the input, u, is represented 
by a second order system of the form [6] 


u(s) _ kuf 2 

ti*(s) “ s 2 + 2(us +u> 2 ( 23 ) 
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and consider the case when the magnitude of the servo-input, ti*, is limited 
by saturation. Further, we consider rate-boundedness of the servo-input by 
adding an integrator in the actuator-model, as follows (see Figure 3) 


u*(s) 1 

u(s) ~ 7’ 


(24) 


and by adding a constraint on the servo-input-rate, u. If saturation is 
avoided, then the state space model of the entire system can be described as 


ii(t) = x 2 (t) 

*2(0 = x 3 (t) 
x 3 (t) = X A {t) 

x 4 (<) = —u> 2 x 3 (t) - 2 Cu>x 4 (t) +ku 2 xs (t) 

Xs(t) = u(t) 


(25) 


where the constants are chosen as k = 1 , w = 1 and ( = 0.7 in the simulations. 
Further, a feedback law, K, is also assumed to be given such that the closed 
loop system is stable. For all simulations, K is fixed as 


K — [—10 -20.5 - 17.3 -3.75] 



FI 

- 

i 


" 1 

0 

u* 

kffl’ 

A 

u. 

1 

S’ 


□ 

s*+ 2^(0 s + (O’ 

s 

J7 

□ 



Scrvo-ruc 



Servo-input 


Servo- Actuator 

Plant 


limiter limiter 

Figure 3. Example System 

Constraints: The servo-input is to be limited as (see Figure 3) 

u *(<) = * 5 (<) € (- 1 , 1 ], 

which also limits the input to the system, u(t). This input, u(t), represents 
the generalized acceleration, y(t) = x 3 (*). Further, the servo-input-rate, 
u(t), is limited to 

ti(t)€[-l,l] . 
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In the following, the control authority is split 50-50 between the primary 
guidance and the recovery guidance as follows: the primary guidance gener- 

a or is to ensure that the servo-input and the servo-input-rate are less than 
half the maximum limits, i.e., 


I«ff (01 < 0.5 
KefWI < 0.5 


(26) 


“ d the recover y generator should ensure that the servo-input and 

the seruo-mput-rate do not saturate - by limiting them also to half the 
ceptable bounds, i.e., 


ac- 


l«fb (*)l < 0.5 

M0I ••= M0-*5 re f(<)l < 0.5 


(27) 


gn , l j nmary G J u,dan « Generator: Let a desired output 

profile, and lts time derivatives (upto the fifth time derivative) be 

given. Then, the exact-output tracking input-state trajectory can be found 
from equation (25) as (note that the existence of the time derivatives is a 
necessary condition for exact-tracking [7]) 


Xl ref 


' Vd(t) 

X 2 re f 



X3 ref 

(<) = 

»f(0 

x< ref 


iFW 

. Xs ref . 


. A [»?’(<) +2(y< 3 l(t) +u, J v< 2 >(t)] 


(28) 


where the bracketed superscript stands for tim^derivative. The exact-tracking 

nei ky 


“ ff (<) = is ref« = is (#?’(«) 


+ 2f*? , W +w 2 yf(f)] . (29) 

Note that the restrictions on the primary guidance, equation ( 26 ), may im- 
P y a some of the desired trajectory profiles may not be feasible - thus 
requiring the redesign of the desired output trajectory profiles (see ( 16 ) for an 
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optimal approach to output-trajectory redesign for invertible systems). Fig- 
ure 4 shows a primary guidance trajectory for changing the the generalized 
position, y, from 0 to 10. Figure 5 shows the system response, when the input 
is allowed to saturate - note the rapid degradation of tracking-performance. 
The initial error was a 10% error in the position (compared to the maximum 
change in position of 10) and all other state-components has zero error. . 
Next we discuss the generation of the recovery guidance maneuvers for such 
large errors that lead to performance deterioration. Note that if the initial 
errors were relatively much smaller, then recovery guidance is not needed. 

Development of Recovery Guidance: To reduce the number of simu- 

lations, in the following discussion, it is assumed that the initial conditions 
of the actuator states, £3, £4,25, are zero, i.e. initial errors have the form 

[ex e 2 0 0 0] T 

If the initial tracking errors in the actuator states are non-zero, then the only 
change is that the number of initial errors (comer points of the error-set) for 
which the recovery guidance needs to be precomputed increases from 2 2 to 
2 5 (and 28 more simulations needs to be presented). 

In the simulations, the non-zero initial tracking errors of the generalized 
position and velocity are also assumed to be in the following range (see 
Figure 6) |ex| < 5 and |e2| < 0.5. This corresponds to a 50% error in the 
initial-position when compared to the maximum change in position in the 
primary guidance law (see Figure 4), and approximately 50% error in the 
initial-velocity when compared to the maximum velocities in the primary 
guidance law (see Figure 4). 

For this particular example, we compute recovery guidance laws for four 
extreme initial errors ( e 1 , e 2 , e 3 , e 4 , which are comer points of the set of 
acceptable initial errors in Figure 6), and the results of the recovery guidance 
maneuvers are shown in Figures 7-10. Even with substantially large initial 
tracking errors the resulting recovery guidance maneuvers lead to recovery 
of trajectory-tracking without violating input or state constraints (compare 
Figures 7-10 with the case without recovery-guidance in Figure 5). How- 
ever the design of such recovery guidance requires the manipulation of the 
weighting matrices in the cost-criterion and requires repeated simulations to 
check performance. This design is not computationally-feasible, on-line, for 
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an arbitrary initial condition. The idea is to generate recovery guidance laws 
that satisfies the system and input constraints for a few initial conditions and 

then use these to generate, on-line, recovery guidance laws for other initial 
conditions. 

For the present problem, the other acceptable initial conditions are in 
the square, defined by the four extreme (corner) points in Figure 6. An 
acceptable initial error, e(0) can then be written as a convex combination of 
the corner points (e 1 , e 2 , e 3 , e 4 ) as 


«(0) = £ A m e m 

1 

with A m := 7l m 7 * where 


7i 


7 2 m 


(1/10) (ei(0) +5) 
(1/10) (5 -e,(0)) 
(e 2 (0) +0.5) 

(0.5 - e 2 (0)) 


if m € {1, 2} 

if m € {3, 4} 

if m € {1, 4} 

if m e {2, 3} . 


(30) 


The recovery guidance law can also be written as as a convex combination of 
the precomputed recovery guidance laws (for the corner points) as in Proposi- 
tion 2. Simulation results are presented in Figure 11, which shows the results 
of the recovery guidance maneuver - output-tracking is achieved without vi- 
olating the constraints. Note that this is the same initial error that lead to 
input saturation and lead to loss of tracking when recovery-guidance was not 
used (compare Figures 5 and 11). In contrast, the recovery guidance maneu- 
ver is guaranteed to satisfy state and input constraints. A second initial-error 
is also chosen that represents a larger 25% initial-error in position. As seen 
m Figure 12, output-tracking is still recovered by the guidance generator 
without saturating the servo-input or the servo-input-rate. 


6 Conclusions 

A method to modify guidance laws to recover trajectory-tracking without 
violating input and state constraints was presented. The technique uses re- 
covery guidance laws that are precomputed for a few initial conditions to 
generate satisfactory recovery guidance maneuvers for other initial condi- 
tions. The technique was applied to an illustrative example and simulation 
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results showed that guidance modifications can successfully achieve recovery 
of trajectory tracking even with relatively large initial tracking errors, which 
could otherwise lead to actuator saturation and eventual loss of tracking. 
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Figure 4. The Primary Guidance Law (x-axis represents time). 



Figure 5. Results with Input-Saturation. Initial Position Error = 1, Initial 
Velocity Error = 0. Dotted line represents primary guidance, x-axis 

represents time. 
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Figure 7. Precomputed Maneuver: Initial Position Error = 5, Initial 
Velocity Error = 0.5. Dotted line represents primary guidance. Solid line 
represents modified maneuver, x-axis represents time. 



Figure 8. Precomputed Maneuver: Initial Position Error = 5, Initial 
Velocity Error = —0.5. Dotted line represents primary guidance. Solid line 
represents modified maneuver, x-axis represents time. 
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Figure 9. Precomputed Maneuver: Initial Position Error = -5 Initial 
elocity Error - 0.5. Dotted line represents primary guidance. Solid line 
represents modified maneuver, x-axis represents time. 



Figure 10. Precomputed Maneuver: Initial Position Error = -5 Initial 
e oci y rror _ -0.5. Dotted line represents primary guidance. Solid line 
represents modified maneuver, x-axis represents time. 
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Figure 11. Results of Recovery Guidance Using Precomputed Trajectories 
Initial Position Error = 1, Initial Velocity Error = 0. Dotted line represents 
primary guidance. Solid line represents modified maneuver, x-axis 

represents time. 



Figure 12. Results of Recovery Guidance Using Precomputed Trajectories 
Initial Position Error = -2.5, Initial Velocity Error = -0.25. Dotted line 
represents primary guidance. Solid line represents modified maneuver. 

x-axis represents time. 
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Abstract 

In this paper, we extend stable inversion to nonlinear time-varying systems and 
study computational issues - - the technique is applicable to minimum-phase as well as 
nonminimum- phase systems. The inversion technique is new, even in the linear time- 
varying case, and relies on partitioning (the dichotomic split of) the linearized system 
dynamics into time-varying, stable and unstable, submanifolds. This dichotomic split 
is used to build time-varying filters which are, in turn, the basis of a contraction used to 
find a bounded inverse input-state trajectory. Finding the inverse input-state trajectory 
allows the development of exact-output tracking controllers. The method is local to the 
time-varying trajectory and requires that the internal dynamics vary slowly, however 
t e method represents a significant advance relative to presently available tracking 
controllers. Present techniques are restricted to time-invariant nonlinear systems and 
in the general case, track only asymptotically. 
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1 Introduction 


In this paper, the stable inversion problem for nonlinear time-varying systems is solved. The 
approach is quite novel in that it applies to nonminimum phase systems - - even the linear 
version of our approach is new in the time-varying context. The basic idea is to compute 
the inverse dynamics, through a contraction, to find an input-state trajectory that achieves 
a desired output trajectory. To develop output tracking controllers, the input trajectory 
(found through inversion) can be used as a feedforward input signal in conjunction with 
any conventional feedback control law that stabilizes the inverse state-trajectory [1], The 
present work completes a line of research which was motivated by the inversion of time- 
invariant articulated flexible structure dynamics [2], and extends our work on inversion of 
general affine-in-control time-invariant nonlinear systems [3]. 

System inversion is key to recent results in exart-output tracking for autonomous systems 
[1, 3, 4, 5] - this paper extends these results to exact-output tracking of time- varying systems. 
The output tracking problem has a long history marked by the solution of the linear time- 
invariant regulator problem by Francis [6] and the nonlinear time-invariant generalization 
made by Isidori and Byrnes [7]. The linear regulator is designed by solving a manageable set 
of linear matrix equations, whereas the nonlinear regulator requires the nontrivial solution 
of a first order partial differential algebraic equation. These approaches asymptotically track 
any member in a given family of output signals. More recently, there have been refinements 
of these approaches. Huang and Rugh [8] used a formal Taylor series expansion of the 
Isidori-Byrnes PDE and gave a sufficient condition for solvability. Krener [9] extended this 
work by providing necessary and sufficient conditions for the term-by-term solvability of the 
Taylor series. Robustness issues are studied by Huang and Rugh [10] and Huang and Lin 
[11]. Other methods that result in approximate tracking can be found in ([12], [13] and [14]). 

The Francis and Isidori-Byrnes regulators apply to time-invariant systems and have the 
property that they track any one of a family of signals asymptotically. Our approach trades 
the requirement of solving the partial differential algebraic equation encountered in the 
Isidori-Byrnes regulator with the requirement of tracking a specific trajectory (rather than 
any one of a family). Moreover, no exosystem is required, and the specification of trajec- 
tories is simplified. We do, however, introduce boundedness and integrability requirements 
on the output trajectory. The key to our approach is finding a bounded inverse, even for 
nonminimum phase nonlinear systems, for use in generating feedforward inputs. Since in- 
version is key to our method, the works of Hirschorn [15], and Di Benedetto and Lucibello 
([16] and [17]) on inversion are most relevant to this paper. The early work of Hirschorn 
is restricted to causal inverses of time-invariant systems and agrees with our inverse in this 
restricted case. Di Benedetto and Lucibello consider the (nonlinear time-varying) system’s 
initial condition as an input and use inversion in this context - the difference is that we, in 
effect, use noncausal input to set up the desired initial condition, and provide the framework 
for constructing the noncausal input. 

Noncausal feedforward can be used if trajectory preview is possible, or truncated to a 
causal signal at the cost of introducing transient tracking errors [3]. Such noncausal character 
is seen in the linear quadratic setting, but the use of exact inverses in nonlinear tracking 
control is new. The noncausal inverses used here have been applied to the control of flexible- 
link robots in [18]. A recent work by Meyer, Hunt and Su [4] makes extensions in the context 
of air-traffic control. 
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More concretely, consider a nonlinear system described in the following normal form [19] 

y {r) (t) = a(C(0. *?(<)»<] +0[C(<), >?(<), *]«(<)» 

r/(t) = «i[C(<)» *] +^2[C(0»*7(0 i < M0i (1.1) 

where t € K 1 represents time, r = (n , r 2 , . . . , r p )* is a vector of positive integers, y(t) = 

IV lit ), y 2 {t y p {t)] is the output, C represents the output, y, along with the output’s 
time derivatives, and 


y (r) (t) a 




dr> 




Ip 

dt r p 


IT 


(0 


urther, a(-, •, •) and /?(•,•,•) are smooth in their arguments with a(0,0,<) = 0 and 5l (0, 0, t) = 
U lor all t. Let **(•), describe a desired output trajectory - this includes information of the 
time-derivatives of the desired output, i.e., the desired C(-) represented by &(•), and the 

desired 2/ r (•) represented by y< r, (-). For this desired output, the input trajectory that 
maintains exact tracking is given by 


“« 4 (tficrio-wto-tn -1 - «[Cfio. •»(*). *]] - (i.2) 

where it is assumed, for invertibility (I). that the absolute value of detl/31 is greater than a 
positive scalar, t 0 . Then, the system's internal dynamics is given by 

n(t) = St[Cd(!), >?((),() +s I M().-l(f).<]lfl(Ca(<),,(f),(r , [»W(f)-a[0(f), ,((),(]] 

A *[l«,X,«),<). ( J 13) 

Note that, if a bounded solution, %(■). to the internal dynamics | equation (1.3)1 is found 

en a bounded input trajectory (that maintains exact-tracking) can also be found using 
equation (1.2) as 6 


MO - PMo.ViOM]] -1 [yl r) (0 -a[Cf(0,M0><]] • ( 1 . 4 ) 

The main difficulty is that the internal dynamics could have an unstable equilibrium at n = 0. 
Then, typical solutions to the unstable internal dynamics equation (1.3) are unbounded and 
consequently the inputs found through equation (1.2) are also unbounded. A technique to 
n bounded solutions to nonlinear unstable internal dynamics has been developed in [ll 
with extensions made in [4]. Such stable inverse input-state trajectories have been used to 
develop output-tracking controllers in (3). In this paper we extend the theory to the case 
when the internal dynamics is time-varying, and study computational issues. 

2 A Nonlinear I/O Operator 

In this Section we develop a nonlinear input/output (I/O) operator denoted V, which is cen- 

nn ,t° t ‘rTle non ‘ in< 7 nonminimum phase systems. This operator maps bounded 
inputs into bounded Caratheodory solutions [20] of equation (1.3), 

n(t)= 3(t?(t), Vj(t),t); r/(±oo) = 0. 
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Note that the input to the operator is Vj(-), which consists of the desired output trajectory 
and its time derivatives. The basic idea is to construct a contraction whose fixed point is a 
solution to (1.3). The contraction is motivated in the following way. Since it is not known 
whether or not r)(t ) = s[rj(t), Yd{t),t) with T 7 (±oo) = 0 has a solution, we expand s(-, •, •) into 
linear and perturbation terms 

V(t) = A(t)r}(t) + [«[*?(*)» -A(<)i7(t)j, (2.1) 

where the term in the large square brackets represents the perturbation term. If we know the 
perturbation term, then we can establish conditions for the existence of a bounded solution 
to this forced linear system. Our approach is to take a guess at the perturbation term and 
iterate - we start with 

m(-) = 0 , 

and at each iteration ( n > 1 ) solve for a bounded solution to the linear (but potentially 
unstable) equation 


7) n+ i(<) = A(t)rj n+i (t) + [s[r/„(0,>rf(<),<] - A(t)r] n (t)]. 

We then prove that this iteration converges to, r) d (-) 4 A/'[F rf (-)], a bounded solution of the 
differential equation (1.3). We begin with the linear counterpart of Af, denoted A which 
finds bounded solutions to the above (unstable) linear equation, i.e., 

Vn+i(t) 4 ^IaM-),W,-]-^(-M-)](0. 

2.1 Linear operator A 

For a system of the form i)(t) = Ar](t) + Bu{t) , with A having no ju>- axis eigenvalues, 
various input-output operators may be defined. The most common operator used in control 
theory imposes an initial condition of the form 77 (^ 0 ) = *?o on the state trajectory. In this 
Subsection, we define an operator A, which imposes an alternative boundary condition, 
T^(ioo) = 0, on the state trajectory: so that the resulting state trajectories are necessarily 
bounded. 

Consider a linear time- varying system of the form 

t)(/) = A(t)r){t) + v(t) (2.2) 

where rj(t) € and A(t) € 3f? n ” xn '>. The key idea is to make a state transformation splitting 
the system (2.2) into two decoupled subsystems; one of which is exponentially stable and the 
other is exponentially unstable. By integrating the stable subsystem forward in time, and 
the unstable subsystem backward in time, a bounded solution to the differential equation is 
obtained (see [3] for a similar approach in the time-invariant case). Although the decoupling 
of time-invariant linear systems is easily done by using a state-transformation constructed 
with the eigenvectors of the A matrix, this approach does not lead to the necessary decoupling 
in the time- varying case [21]. 

In the following, we use results by Coppel [21], to establish the dichotomic split that 
enables extension of the stable-inversion theory to the time-varying case. 
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Definition 1 Kinematic Similarity [21] 

The homogeneous equation 

m = A(t)r}(t) (2.3) 

with A(-) continuous for all t € R 1 , is defined to be kinematically similar to 

w{t) = B(t)w(t). (2.4) 

provided: there exists a transformation S(-) such that for any given solution w(-) to equa- 

r 1 nn / 9 A 1 v ' * 


v(t) 


S(t)w(t) 


(2.5) 


is a solutjon to equation (2.3), S(t) is a continuously-differentiable invertible matrix, and 
both 6(tf) and S ( t ) are uniformly bounded for / € 3? 1 . □ 

By substituting equation (2.5) into equation (2.3) we see that S(t) necessarily satisfies 

S(t) = A(t)S(t) - 


The k ey is to find a Kinematic similarity that achieves the dichotomic split of the linear 

Ym em • mt ,° S ! at>le and unstable subsystems. This dichotomic split is possible provided 
( ) : (a) is slowly varying in t ; (b) is uniformly bounded in f; and (c) is hyperbolic. 
These conditions are formalized next, and the dichotomic split is established in the following 

I heorpm & 


Condition I A(t) £ ft""*"" satisfies condition I, if there exists positive M,a,0 such that 
lor every t £ Si 1 

i- IMWIUo <m. See Nomenclature for the definition of || * j| 1+ 

2. A{t) has k eigenvalues with real part less than or equal to -o < 0 and n - k 
eigenvalues with real part greater than or equal to 0 > 0, where 0 < k < n * □ 


Theorem 1 


Let A(t) satisfy condition I. Then for any positive scalar e < min(a 3) 
positive scalar 8 = 8(M,a + /?,c) such that, if || f t A{t) ||, +oo < 8 for every 


there exists a 
t € R 1 , then 


1. Equation (2.3) is kinematically similar to 


d_ w,(t) 
dt w u (t) 


where w 3 (t) £ 8 w u (t) £ . 


B,(t) 0 
0 B u (t) 


w 3 (t) 
w u (t) ’ 


(2.6) 


2. Father, w,(t) -B(t)w s (t) is exponentially stable and th u (*) = B u (t)w u (t) is exponen- 

... y “ nstable - That the respective fundamental matrix solutions (see [20], pg 80) 

W, and W u satisfy v 1 h ' 


II ^.(OW / r 1 (5)|| 1+00 < fort>s 

H^(0tF- 1 (s)|| 1+oo < Ke-W - *> fors>t. 
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3. The associated transformation 5 satisfies 


(2.8) 

(2.9) 


l|S(<)ll 1+ „ < AT,(M,a + jM 

IIS-’Wlli+o. < JV 2 (W,o + /3,€). 

Proof: This follows from Coppel’s work [21] (in particular, see Lemma 2 and Theorem 3). 

□ 


Remark 1 Note that an important condition in the above Theorem is that A(-) is slowly 
varying in time. □ 


The above dichotomic split of the system into stable (tu,) and unstable (u> u ) subsystems 
leads to the following bounded solution to linear system (2.2). Given A(-) satisfying the 
conditions of Theorem 1, a linear operator A that finds bounded solutions to system (2.2) 
is given by 


Definition 2 . 

For u(-) € Li D Loo, 


where 


A(v)(t) 4 S{t) 


/loo W.(t)W M - l (r)S.(T)v(T)dT • 

-/ t 00 ^(<)^- 1 (’-)*?u(T)v(T)dT J ’ 


S,(t ) 4 [/* x * 0 tx(n ”- fc) ] 5 _1 (f) 

Suit) 4 [() (n,I ~* )x * /("n-*)x( »,-*)] £-1^ 


W 3 ,W U ,S are as in Theorem 1, and without loss of generality 1^,(0) = I kxk , VF u (0) = 


Corollary 1.1 Given an operator A as in Definition 2, 

1. || A[u(-)](-) || 1+00 < G^|| t>(-) ||, +00 for some Ga (finite gain property) 

2. A : Lj n Lqo — ^ Li n Lqo n c° 

3. lim ,4(t>)(i) = lim A(u)(t) = 0 

Proof: See [1]. □ 

This linear operator, A , finds a bounded solution to an unstable linear system. This operator 
is extended to a nonlinear operator (that finds bounded solutions to the nonlinear internal 
dynamics) in the next Subsection. 
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2.2 


Generalizing A to Nonlinear Case; the Operator Af 


The following Condition requires that, the perturbation term in equation (2.1) satisfies a 
locally Lipschitz-like condition in both rj and Y . 

Condition II The pair [s(-, -,•),/!(•)] satisfies condition II if, for any Vi(-) KM a B ny 

r d 6 / r "’’ ’ ! he P erturbation term %(•), y(-), ■} ~ satisfies the following 

Lipschitz-like condition (uniformly in t), 6 


II { 5 [ J 7i(0^i(0,<]-^(0^(0}-{s[772(t),y2(#),<]-/l(^ 2 (<)} || 


l+OO 


< A"lll h(t) - ih(t) || I+0o + A'alJ Yt(t) - Y 7 {t) ||, +00 (2.10) 

where S : *- x K«v x B _ R »,, A € Md ^ denotes & bM Qf radjus f ^ ^ 

appropriate space (see nomenclature) . g 

Condition II is applicable even when s(; v ) is not difTerentiable. For example, 
[»?( ij(t) + 0.1 177(<)| + Y{t), which is not differentiable at 77 = 0, satisfies the 

above condition with A(t) = 1. However, a afo(.), Y(-), •] with a step discontinuity in the 
first variable at r\ - 0 does not satisfy this Lipschitz-like Condition II for any z4(.). □ 

wUNhlw A ^ USed t0 definC a contraction - ’VO). ^ particular, Theorem 2 

will show tha V Y (-) is a contraction and Theorem 3 will show that the fixed point of Vy (•) is 

a bounded solution to the nonlinear internal dynamics (1.3). Note that, for ease in notation 
r (•) and Y d {-) are represented as Y and Y d respectively. 

Definition 3 

ry(m A A [%(.), K(.),-]-A(.M-)](t), (2.11) 

Wh f r f e ; ^ ^ Br'i ^4( ) satisfies Condition I and the conditions of Theorem 1 

bv n l’’’ 0, S eS COnd , iti0n IL Note that ’ for ea5e in notation ’ n(-) is represented 
by rj whenever the meaning is clear. ^ 

Theorem 2 Ul the conditions in Definition 3 be satisfied, and the Lipschitz constants, (A', , A',) 
C f dl ‘'°i 11 sat,sfy h ' Gj ‘ < *• and KiG* < 1 - A'.Gx, where G A is the bound on the 

h ° P " at ° r , i (see Corollary 1-1)- Then, there exists a unique € S»r 

such that t fr(t) = V Y [ri'y{-)){t). ,Yy ’ r ’ 

Proof: From Corollary 1.1 for any >'(•)€ 5" y we have 

II ’VM(-) ll, + „ < G a || s[p(-), V(-), -] — A(-)rj(-) J| 1+oo 

< G a (a'j|| rj(-) || 1+00 + A 2 || K(-) || 1+0o ) . (2.12) 

7 P ' ie3 J Y }1 < r ' ~ have < 1 - K,G A , that p r( .) : 

we obtain fr ° m ^ definltlon of Vy ’ hnearity of A, CoroUary 1.1 and condition II, 

IHMb.)( )-7Vfe)(-)||, +00 < G A K, II -!.(•) -hs(-)|| 1+0o . (2.13) 

Mapping Theorem ^ at ^ “ C ° ntraCti ° n ' “ d the Theorera the Contraction 

□ 
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Remark 3 Equation (2.13) implies that Vy [*/(*)](*) is Lipschitz in r/(-). 


□ 


Theorem 3 Let the conditions of Theorem 2 be satisfied, F(-) € By and A^(T) A rjy(-). 
Then (see [3] for an analogous result) 

1. Af(-) : By By n C 0 and £[Af{Y)](t) = 5 [[AT(y)](t),y(t),<] a.e. in t 6 ft. 

2 . Jm |V(y)](«) = t lim tV(y)|(t) = 0 

Proof: Theorem 2 and the Contraction Mapping Theorem implies the existence of a unique 
fixed point rjy(-) € By such that 

r]y{t) — 'Py(rfy)(t) = A [$[*£(•)? T(-), •] — A(-)r7y(-)](t) 

ll-*(-)ll 1+ „ < y(-) ll.^o (214) 

hence 77y-(-) € L\ H fl C° from which the first assertion of the Theorem follows. Next, 
consider the sequence 

*&(•) = o 

n lY +l (t) = Vy(tf)(t), (2.15) 

which converges to r)y(-) uniformly in t. The uniform convergence of this sequence, and the 
fact that 

lim rjy(t) = lim r)y(t) = 0 

for all n > 0 (by Corollary 1.1), implies the second assertion of the Theorem. □ 

In particular, the last Theorem shows that rij(-) A [-^(^d)](‘) = Vy d (') a bounded solution 
to the internal dynamics (1.3), i.e., = slld{t),Yd(t),t] . 

3 Computational Issues 

Computation of the inverse input-trajectory, u,i(-) requires: (a) iterative integrations over an 
infinite time window to find [Af(Vj)](-) (Section 2); and (b) computation of a transformation 
S that achieves the dichotomic split (Definition 1), which is also an iterative process ( see 
[21], Theorem 2 and Theorem 3). In this Section we show that it is possible to compute 
with a single iterative process, an approximate inverse input-trajectory, £<*(•), and establish 
bounds on the error, || uj(-) — u,*(-) ||, +0O . 

3.1 Errors due to truncations and finite iteratio ns 

In the last Section, we found a bounded solution to the internal dynamics (1.3) by iteratively 
finding the fixed point of the contraction Py <f ( - ). Each step in the iterative procedure required 
computations over the whole real line. Here we truncate Vy d (-), to the compact interval 
[— T, T] and thus define a new operator Py d ,r(‘)- In the following, we begin with a general 
output trajectory T(-). 
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Definition 4 Let the conditions in Definition 3 be satisfied, vM £ L, D L VM c 
and T £ Then V ' r 


^r(w)(f) 4 5(<) 


£r^(0W7V)&(rMr)<fr ' 
-J t T W u (t)W-\r)S u (T)v(T)dT J ’ 


for all t £ [-T, T] 
A 0 otherwise, 


V Y ,T{v){t) 4 ^r[s[T7(0i>TM-4(->7(-)](<) 
with 5, 5 a , 5 U , W a , W u as in Definition 2 . □ 

The following Theorem will establish that the above truncated map, V Y>T (-), is also a con- 
traction. The goal is to show that, for a given V(-), the fixed point of the truncated map is 
close to the fixed point of the original map, V Y {-). 

Theorem 4 If G .4, the bound on the gain of the linear operator A A'i and Ki are suffi- 
ciently small then there exists a unique fixed point of V Y , T (-). Further, the sequence 

{*7K,7\m(-)} m=0 > defined by 

W.r.o(-) 4 o 

W.T.m + l(0 4 ^y.riVY, T,m)(t) (3.1) 

converges to rj Y j(-) in the || • ||, +oc sense (as m increases). 

Proof: This follows from arguments similar to those in the proof of Theorem 3. □ 

The following lemma establishes that V y (,,)(■) = ffin TY,r(r?)(-), in the || • || 1+oo sense. 

Lemma 1 Let rj(.) £ B^. Then Iim T ^ || V Y (rj )(•) - V YtT (i)(.) || 1+oo = 0 
Proof: We first show that 


fell ?>•<>()(•) -*V.r(i?)(-)ll, = o. 

For ease in terminology we will use the following notations 

->(/) 4 aM0,y(0,<]-i4(<)i7(<) 

^.(/.r) 4 W,(t)W,- l (T)S,(T) 7 (T) 
%(Lt) 4 ^ u (t)H/- 1 (r)5 u (r) 7 (r). 
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Then from Definitions 2,3 and 4, we obtain 


II 'Py{i])(-) -V y ,t{v)(-)\\i = / M (7)(<) - -4 r (7)(<) 

+ jl T II -Mnm - Ml )(<) II,* 

+ w Mm - Mim\\,<u 

We illustrate the proof technique for only one of the terms. The rest of the proof follows 
from similar algebraic manipulations. From Definition 2 and Definition 4, 

f T w M)w - Mimwm < r T ii sM ii, /' ii7.(<,T)n,rfr* 

J J — OO J— oo 

r-T r+oo 

+ / II S(<) Hj I || -y u (t, t ) Hjdrdt 

J — OO JJ 

For the first term on the r.h.s. apply inequalities, (2.7), (2.8) and (2.9) to obtain 

/_JI S WiLj^ T )Wi dTdt - N \ N iK j_ J e -( °- t) ( < - T )|| 7 (r) ^dTdt 

< NiN^K f ( e - (° , - £ )( t - T )|| ^,( r ) ftdtdr 

J — OO J T 


NjNrK 
a — e 



e (»-<)(T + .)j || 7(r)| | ](ir . 


Since r < -T, and a - t > 0, we have 0 < e (o-t)(r+T ) < 1 and hence 


f T II SW II, /' |h,((.T)||,rfrrf( < Mil r T || 7 (r)Mr 

J -co J- oo a — e 7-oo 


This tends toOasT — >■ oo if ->(•) € L\. which follows from the definition of 7(-), Condition II, 
r}{-) € Ii n Loo and y(-) 6 L| D L x . Similarly, the other terms also tend to zero as T — ► oo. 
The key is to rewrite them, either as integrals from -oo to -T, or as integrals from T to oo 
and then show that the integrals go to zero as T tends to infinity. 

Next we show that limbec || V Y (v){t) - TV.rfaXO IL = uniformly in t We split the 
proof into three parts: (a) t < -T; (b) -T <t <T\ and (c) T<t. We illustrate the proof 
technique for case t < —T only. For t < —T 

||7>K(r?)(t)-Pv,T(r7)(OIL < II ^Y(ri){t) - V Y ,T{v){t) II i 

= M (7)(0-^ r (7)(<) ll , 

- W S ( t )\\i+o 0 (J_ oo \h’( t > T )<lT\\ 1 + J t || 
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< N,N,K (J_^ 7 (r )dr ||, + jT e -W-.Hr-.)|| 7 ( 7 )* ||, 

< AT, A' 2 A- (^ || 7(7)* II, + jT || t(r)dT ||, j 


7 6 Ll !J npll f S that the r - h ' s tends to 0 as T -> oo independent of t, and hence l.h.s tends to 
zero uniformly m t. The other two cases, when t > -T, can be proved by similar arguments. 

proJf □ 18 6StabIished iD the II • Hi and in the II • Hoc norms, which completes the 


The next Lemma states that T?y r ( ), the fixed point of the truncated operator V YT (-) tends 
to rj Y ( •), the fixed point of the operator Vy(-), as T -)• oo 
(see [20], page 7, for a related Theorem). 

Lemma 2 For all e, > 0 there exists T,( ei ) such that T > 2\( Cl ) implies that 
IIW,r(-)-»ft(-)ll 1+ oo<ei. 

Proof: 


II ^,r(-)-^y(-)lli+oo = II p ^( r ?v',r)(-)-^r(»/y)(-)|| 1+00 


^ II M^,r)(-)-^r(^)( 

+11 Vy (t}y,t) (•) - (^t) (•) 111 


1 1+00 


+ oo 


Remarkir 5 ^ 16 NeXt ’ Using the Lipschitz P ro P ert y of *V(‘) we obtain (see 

II VrM - *lv(‘) lli+oc < A'jGUII n K,r(-) - V y(-) || 1+00 

+ 11 V Y (j!y,t) (•) — Vy,t (0 


1 1 + 00 


II 7 ?v,r( ) Vy(-) lli+oc ^ 1 - R\Ga II ^ Y ( r?YT ) ^ ~ 7>y ' t O&r) (■] 


I l+oo ’ 


te, from Lemma 1, we have Vy{r]y T ) - ^irn Pr.rf'/v'.r)’ an d hence the right hand side 
can be made arbitrarily small by choosing T large enough D 

torardv g ‘r th<! "T reSUlt lhat ’ the “ Verse ‘^tory «“> b* approximated (ar- 

a ' . h l y ly) ty Ch00 , Sm 1 g a large enough time wi ” do »' for computations in each iteration 
and by using a sufficiently large number of iterations. 

luL e (7- m , t < > V here “fL M ' T ‘ SUCh that m>M ’ T>T ' ™P'ies that 

input u d (.)l defin“d“al' ^ eqUati0n (U) “ d the approximate inverse- 

M‘) A Wa 0 , m ',. r . 4 i ),<]]-'[ pr ( 0 - o [ K J ( ( ), w . aXm ( i M) ]. , 3 . 2) 
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Proof: Lemma 2 and the convergence of sequence Ty^r.mO) (see equation (3.1)) imply that 
|| VY d ,T,m{') — T}y d ( • ) Hi+oo can be made arbitrarily small by choosing T and m large enough. 
The Theorem follows from the continuity of u(t) in 77(f). □ 

Summarizing, given an t > 0, Ud(') can be computed through a finite number (m) of iterative 
integrations performed over a closed time interval [— 7 1 *, 7’*], such that || «<<(•) “«<*(•) lli+oo < 
e. This bound, c, can be made arbitrarily small by increasing T * and m. 

3.2 Computation of S(-) 

Given a nonlinear time-varying internal dynamics, 17(f) = s[?7(f), Y(t), f], the key is to find a 
pair (A(-), S(-)) such that: (a) s[?7(f), F(f), f] — Arj(t) satisfies the Lipschitz-like Condition II; 
and (b) the change of variables 77(f) = S(t)w(t) achieves the dichotomic split of the linear 
equation rj(t ) = A(t)rj(t). The existence of the block-diagonalizing transformation S(t) has 
been studied in [21], however, the computation of the transformation is iterative. Below, we 
present a modified algorithm that circumvents the iteration. 

Algorithm for S(-) [Coppel] 

1. Choose A(-) (not necessarily = -^s) such that; (a) || A(t) || 1+oo is bounded, and slowly 
varying; and (b) s[77(f), Y(t), t] - Ar}(t) satisfies the Lipschitz-like Condition II. 

2. Compute the projection operator (onto the stable subspace of A(t)) 

where 7 is the simple closed curve in the left half plane formed by the imaginary axis 
and part of the circle |A| > || A || (see [21], page 511) 

3. solve the first order linear ordinary differential equation ([21], page 513) 

inn = \Hnpw - pwm\m\ uio) = i, 

4. and compute S(t) ^ U(t)R~ l (t) with 

R(t) 4 [P(0)U’(t)U(t)P(0) + {I- P(0)}U m (t)U(t){I - P(0)}] 1/2 . 

This S(t ) cannot be used to decouple A(t), although such a decoupling transformation 
can be found using the iterative algorithm in ([21], see Theorem 2). Instead, we choose 
an alternate A{-) matrix. 

5. Choose A(t) A A(t) + S{t)S-'{t) □ 

It follows from Coppel ([21] Theorem 3) that: (a) S(-) decomposes A(-) as in Theorem 1; 
and (b) || 5(t)5 _1 (<) ||, +00 is proportional to the || A(-) || 1+oo . This proportional dependence 
implies that A(-) also satisfies the Lipschitz-like Condition II. (if it is satisfied by a slowly- 

varying >!(•)). This concludes the algorithm to compute the dichotomic split of the linearized 
internal dynamics. 
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4 Conclusions 


In this paper we have defined a new method for inverting nonlinear nonminimum-phase 
time- varying systems, and have presented a constructive algorithm for computing inverse 
trajectories. The inverse trajectories form the basis of a new exact output tracking controller 
Since the noncausal inverses decay to zero exponentially in negative time, truncation is 

“^old ^ analyZ6d " a11 the desirable continuity properties of the truncation were 
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Nomenclature 

If f (') denoted by x ) is a vector valued function with x(t) = fx,(<) xi(t) x-iit) x i/il 7 " 

6 f ' ' th “ II *«> II, A Sir MOI is the standard 1-nlrm in * x(f , || A max lx )| 

is the standard oo-norm in ft", and || x{t) || 1+ A II x(t) II + II x(t'\ II °° “ ’ 

If *(0 6 is a matrix then || L(t) || , i^iL^!^ ’ ' L ' 

■ 4 su PMi0 , || z(t) vlla/H Vila, 

II 2 W IL 'S the induced oo-norm, II z(t) II A sup „ llzft)„ll /II..II 
and || z(l) ||, + „4I| z(t) ||, -m *(<) L' = P ^- 11 2(,) y ■-'» » “= 

ll !, f X i'l, (a : S r, de r t l d by X) iS a VeCt ° r Valued measura ble function, then 

11*11! 4 II *(0 lli A /“oo MOM*, 

II * Hoc 4 II *(■) Hoc 4 ess sup t€ * || X(t) || and 

II *(') Hi+oo4|| z(-)||, + || x(.)|| 0o . 

K (‘) e B r Y implies K(<) e ft"v and || Y {.) || < r . 

»?(•) € B implies ij(t) e ft"” and || tj(-) || 1+oo < r. 
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I. Introduction 

G IVEN a desired output trajectory, inversion-based techniques 
find input-state trajectories required to exactly track the 
output. 1,2 These inversion-based techniques have been successfully 
applied to the endpoint tracking control of multijoint flexible ma- 
nipulators in Ref. 3 and to aircraft control in Ref. 4. The specified 
output trajectory uniquely determines the required input and state 
trajectories that are found through inversion. These input-state tra- 
jectories exactly track the desired output; however, they might not 
meet acceptable performance requirements. For example, during 
slewing maneuvers of flexible structures, the structural deforma- 
tions, which depend on the required state trajectories, may be unac- 
ceptably large. Further, the required inputs might cause actuator sat- 
uration during an exact tracking maneuver, for example, in the flight 
control of conventional takeoff and landing aircraft. 5 In such situ- 
ations, a compromise is desired between the tracking requirement 
and other goals such as reduction of internal vibrations and preven- 
tion of actuator saturation; the desired output trajectory needs to be 

redesigned. . . 

Here, we pose the trajectory redesign problem as an optimization 
of a general quadratic cost function and solve it in the context of 
linear systems. The solution is obtained as an off-line prefilter of the 
desired output trajectory. An advantage of our technique is that the 
prefilter is independent of the particular trajectory. The prefilter can 
therefore be precomputed, which is a major advantage over other 
optimization approaches (see Ref. 6 for further references). 

Previous works have addressed the issue of preshaping inputs 
to minimize residual and in-maneuver vibrations for flexible struc- 
tures; see, for example, Refs. 6 and 7. Since the command preshap- 
-ing is computed offline, in Ref. 8, the use of noncausal prefilters has 
been suggested — such noncausality is allowable since the command 
preshaping is computed off-line. Further, minimization of optimal 
quadratic cost functions has also been previously used to preshape 
command inputs for disturbance rejection in Ref. 9. All of these ap- 
proaches are applicable when the inputs to the systems are known a 
priori. Typically, outputs (not inputs) are specified in tracking prob- 
lems, and hence the input trajectories have to be computed. The 
inputs to the system are, however, difficult to determine for non- 
minimum phase systems like flexible structures. One approach to 
solve this problem is to 1) choose a tracking controller (the de- 
sired output trajectory is now an input to the closed-loop system) 
and 2) redesign this input to the closed-loop system. Thus, we ef- 
fectively perform output redesign. 6 These redesigns are, however, 
dependent on the choice of the tracking controllers. Thus, the 
controller optimization and trajectory redesign problems become 
coupled; this coupled optimization is still an open problem. In con- 
trast, we decouple the trajectory redesign problem from the choice 
of feedback-based tracking controller. It is noted that our approach 
remains valid when a particular tracking controller is chosen. In 
addition, the formulation of our problem not only allows for the 
minimization of residual vibrations as in available techniques but 
also allows for the optimal reduction of vibrations during the ma- 
neuver, e.g., the altitude control of flexible spacecraft. 9 We begin by 
formulating the optimal output trajectory redesign problem and then 
solve it in the context of general linear systems. This theory is then 
applied to an example flexible structure, and simulation results are 
provided. 
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II. Problem Formulation 

System Inversion for Exact Tracking 

Consider a square system described by 

x = Ax 4- Bu\ y = Cx 

where x e !H n , « 6 and y e The inversion approach 2 finds 
a bounded input-state trajectory that satisfies the preceding system 
equations and yields the exact desired output, i.e., 

x n{ = Ax T c( + Bu f f\ yd = Cx rc ( 

The inverse input-state trajectories can be described in terms of 
Fourier transforms as 1,11 

Uffiju) = l COW - Ar l B)- l y d (jcv) = G-\jco)yAjo>) (J) 
JrcfO'fcO = ~ A)- x B]u ff {ja>) = G x y<*>)uffU<*>) 

This Fourier-based inversion approach has been extended to non- 
linear time- varying nonminimum phase systems in Ref. 2; however, 
we restrict our discussion to linear time-invariant systems. 

Remark. We note two results. One, an inverse exists if the output 
and a certain number of its time derivatives are bounded. The number 
of time derivatives of the output that needs to be specified for an 
inverse to exist is well defined and depends on the relative degree of 
the system. 2,12 Second, for linear hyperbolic systems, if the inverse 
exists, then it is unique. 1,2 


Performance Criterion f 

Trajectory redesign seeks a compromise between the goal ot 
tracking the desired trajectory and other goals such as reducing 
the magnitude of input and vibrations. We formulate this redesign 
problem as the minimization of a quadratic cost function of the type 



(tf Ru(t) x(t) T Q x x(t) 


+ ty(r) - yAt)?Qyly(<) ~ ^(01 } & 


where R, Q x , and Q y represent the weight on control input, states, 

and the error in output tracking, respectively. 

Using Parseval’s theorem, we rewrite our optimization problem 
in frequency domain as the minimization of the cost function 


/ oc 

| u(ja)Y Ru(j<o) + x(jco)* Q x x(ja>) 

■00 

+ ivOco) - yAj&)YQv\.yUu) ~ yAju)]} 


where the superscript * denotes complex conjugate transpose. 


Optimal Redesign of the Output 

Our main result is given by the following lemma, which shows that 
the optimal output trajectory redesign can be described as a prefilter, 
which maps desired output trajectories y d to the redesigned output 
trajectory y opt . This prefilter G f does not depend on the particular 
choice of desired trajectory and hence can be precomputed. 

Lemma. The modified output trajectory y opt is given by y op iO ^) = 

G f {jci))yAjv)i where 

Gf{jco) = 1 — Gy^R + G* X Q X G X -I- G y Q y Gy] 
x[R + G* x Q x G x ]G- y l 

The modified input trajectory u opt is given by u^jco) = u ff (jaj) + 
u 0 pt(;^)» where u opt 0‘^) = G v (jco)y d (jco) and 

G V U<*>) = -(J? + G* X Q X G X + G' y Q y G y )~ X 

x(r + g;q x g x )g;' (3) 

Note that the dependence on ja> is not explicitly written for com- 
pactness. 

Proof. Without loss of generality, we rewrite the input u as tne 
sum of the feedforward input, found from inversion of the 

desired trajectory, and an arbitrary v. 

u(jco) = UffUco) + v(ja>) = G~ ] (jo))y d (j(o) + v{jw) (4) 

Substituting x(ja)) = G x {ja>)u(j<o) and y(ja>) = Gy(ja>)u(jco) 
along with the preceding Eq. (4) for u into the cost function given 
by Eq. (2), we obtain 
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/ oc 

\[v + {R + G' x Q x G, + G' y Q y G y )~' 

00 

x (R + G’ x Q x G x )G; l y d y * (R + G’ X Q X G X + G)Q y G y ) 
x [« 4- (R + G’ X Q X G X + G’ y Q y Gy)~ l 
x {R + G' x Q x G x )G;'y d ] + (G;‘*)*[(* + G' x Q x G x ) 

+ ( R + G' x Q x G x )' * (R + G;Q X G X + G‘QyG y )~ l 
x (/? + GlQ x G x )](G~ l du; 


Note that the cost function is quadratic in v. Therefore, the cost 
function is minimized by setting this quadratic term to zero, i.e., 
choosing v(ja>) = v opl (jco) = G v (ja))y d (jco) t where G v is defined 
by Eq. (3) in the lemma. The choice of u = u opt defines the optimal 
input M opt through Eq. (4) as 

u opt(j°>) = [G y 1 (jcv) + G v (jo))]y d (ja>) (5) 


with y = 0 2 = [0 1 0 0]*. The control objective is to track the 
angular rotation 0 2 of the disk that is farthest away from the motor 
(see Fig. 1 for the desired output trajectory). 

The relative degree of a single-input/single-output linear system 
is the number of zeros at infinity. 12 For our system, with the torque 
as input and 0 2 as output, the transfer function has four poles and 
two finite zeros [see Eq. (6)]. Thus, the number of zeros at infinity 
are two, and hence the relative degree is two. This implies that the 
second derivative of the desired output, i.e., the desired angular 
acceleration profile of the output, uniquely determines the required 
input-state trajectory and the resulting structural vibration, 0\ — 0 2 } 
If the internal vibrations are to be reduced, then we have to relax the 
exact tracking requirement. Similarly, to reduce the required input 
amplitudes we have to compromise exact tracking. This tradeoff 
can be represented as the minimization of a general quadratic cost 
function (Sec. II) of the form 



[u{t) T Ru{t) + x(t) T Q x x{t) 


The result follows from y^ (jco) = G v (»« opl (» = [1 + G y (ja>) 

GvUo>)]y d (jco). D 

in. Example 

Consider a flexible structure consisting of two freely rotating 
disks connected by a thin shaft. A motor is attached between the 
connecting shaft and one of the disks. Input to the system is torque 
r provided by a dc motor, and the outputs are the angular rotations of 
the two disks 0 X and 62. These angular rotations are measured using 
potentiometers. The transfer function of an experimental system, 
which includes the rigid-body mode and one flexible mode, was 
obtained using a HP3562A Dynamic Signal Analyzer as 

_ 1.8139s 2 4- 0.3077.? -f 6.1041 
r ~ s* + 0.2765s 3 + 6.1041s 2 
(h = 0.27j 2 - 0.1 187j + 6. 1041 
r j 4 + 0.2765.y 3 + 6. 104U 2 


With the state vector* chosen as * = [(9, ft ft ft] r , the system 
equations can be represented in state-space form as x = Ax + Bu, 
i.e., 



-ft - 


0 

1 

0 

o - 

d 

ft 


-3.1555 

-0.1640 

3.1555 

0.3845 

dr 

ft 


0 

0 

0 

1 


.ft. 


_ 2.8956 

-0.0899 

-2.8956 

-0.1124 



-fti 


“ 0 “ 


@2 


1.8139 


ft 


0 


-ft- 


0.27 


+ [y(0 - yAO] T Q y [y(t) - y,/(/)] } d; 
where R = r, Q y = q yy and 

r i —i oo 



L 0 0 0 OJ 

The scalars r, q x , and q y represent the relative weight on the re- 
duction of inputs, structural vibrations, and tracking errors, respec- 
tively. To reduce the vibrations and control inputs, we choose r = 1 , 
q x = 5000, and q y = 1 in our simulations. Figure 1 shows the modi- 
fication for a desired trajectory — about 10% of the final slew angle. 
The maximum magnitude of the required input, however, is reduced 
by 60%, and the corresponding structural vibration, 0| - is re- 
duced by 20% (compared with results from exact tracking of the 
initial desired trajectory). 

IV. Conclusion 

We formulated and solved the trajectory redesign problem in the 
context of linear invertible systems, including nonminimum phase 
systems. Thus, we provide a systematic approach to an optimal 
tradeoff between tracking desired trajectory and other goals such as 
vibration reduction and reduction of required inputs. The approach 
was applied to an example flexible structure, and simulation results 
were presented. Future work will address trajectory redesign for 
nonlinear systems. 
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Exact-output tracking theory for systems with parameter jumps 

SANTOSH DEVASIAf, BRAD PADENJ and CARLO ROSSI§ 

We consider the exact output tracking problem for systems with parameter jumps. 
Necessary and sufficient conditions are derived for the elimination of switching- 
introduced output transient. Previous works have studied this problem by devel- 
oping a regulator that maintains exact tracking through parameter jumps 
(switches). Such techniques are, however, only applicable to minimum-phase sys- 
tems. In contrast, our approach is applicable to non-minimum-phase systems and it 
obtains bounded but possibly non-causal solutions. If the reference trajectories are 
generated by an exosystem, then we develop an exact-tracking controller in a feed- 
back form. As in standard regulator theory, we obtain a linear map from the states 
of the exosystem to the desired system state which is defined via a matrix differ- 
ential equation. The constant solution of this differential equation provides asymp- 
totic tracking, and coincides with the feedback law used in standard regulator 
theory. The obtained results are applied to a simple flexible manipulator with 
jumps in the pay-load mass. 


1. Introduction 

We study the exact-output tracking of systems that are described by 

x(t) = /1[A:(/)].y(0 + B[k(t)]u(t) 

v(0 = C[*(0].v(0 

where y g J8". with the same number of inputs as outputs i /(/), v(/) € D^. The system 
matrices A(k), B(k) and C(k) are constant over the time intervals f k , where k belongs 
to a finite index set JT = [0, . . . , /V], and the parameter change (swatch) occurs at 
times t — t \ , t 2 , . . . , t N (see Fig. 1 ). Here, the switching times are known, in contrast 
to systems w'here the swatches may be signal-driven. 

For constant linear systems, asymptotic output-tracking problems have received 
much attention in the past. In particular, the regulator theory (Francis 1977, Basile 
and Marro 1992, Wonham 1985) provides a general framework in w r hich the asymp- 
totic output tracking can be solved when the reference trajectory is generated 
through a linear exosystem. In the presence of sw itches in the system, one technique 
for achieving output regulation is to switch the regulator. Note that regulation can 
be recovered between two consecutive switches (due to asymptotic properties), espe- 
cially if the switching occurs far apart in time. However, this technique also tends to 
induce transients in the output during the switches. 
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Figure 1 . The switching times. 


In order to eliminate these switching-caused transients, a regulation scheme 
that maintains exact trajectory tracking across system switches must be used. This 
fairly new problem has been studied by Marro and Piazzi (1993) for minimum- 
phase systems. In this work, a feedforward action is used in conjunction with the 
feedback defined by the regulator to cancel the output transients across the 
switches. 

We propose an alternative approach for exact output-tracking of switched sys- 
tems, wffiich is also applicable to non-minimum-phase systems. In the non-minimum- 
phase case, a bounded non-causal solution is obtained (Devasia et al. 1996) that 
requires preknowledge of the reference trajectory and of all the switching times. Such 
exact tracking schemes based on non-causal schemes is useful in problems like 
aircraft guidance (Meyer et al. 1995, Hunt et al. 1996). 

We present necessary and sufficient conditions for the solvability of the inversion 
problem for linear systems with switches; the inverse is used to track the desired 
output. We consider two kinds of desired output trajectory: a single pre-specified 
trajectory, or one belonging to a class of outputs generated by a given linear exo- 
system, that could undergo parameter changes as well. In this latter case, we obtain 
the solution in a time-varying feedback form, where the feedback matrix satisfies a 
matrix ordinary differential equation. The equilibrium solution of this differential 
equation solves the asymptotic output tracking problem, and coincides with the 
feedback matrix resulting from the standard regulator. This establishes an interesting 
connection between our approach and the traditional regulator theory. 

The paper is organized as follows: in §2 the exact tracking of a single prescribed 
output trajectory is considered, and necessary and sufficient conditions are pre- 
sented. A geometric version of the obtained conditions is also provided. In §3 the 
case of reference trajectory obtained through a linear exosystem wall be treated. The 
conditions of the previous section when rearranged establish a close relationship 
with the traditional theory of output regulation. Section 4 focuses on the additional 
problem of stability of the closed loop system. Finally, § 5 presents the application of 
the developed theory to a simple non-minimum-phase switched system, given by a 
flexible beam subjected to step variation of the pay-load mass. Conclusions end the 
paper. 


2. Tracking a prescribed output trajectory 

Below we formulate the exact tracking problem for a prescribed output trajec- 
tory, and establish necessary and sufficient conditions for its solvability. Geometric 
interpretations of these conditions are also provided. 
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2.1. The inversion problem 

Given a desired output trajectory y d , find a pair of state and input trajectories x d 
and u d such that: 

(a) A' d and u d satisfy the system (1): 

x(t) = A[k{t)]x d (t) + B[k{t)\u 6 {t), V/ G (-oo,oo) (2) 

( b ) exact output tracking is achieved (even across switches): 

Vd(') = C[k(t)]x d (t), V/ e (-oo, oc) 

(c) and the inputs and state are bounded: 

ll^d(')lloo < 00 

IMOIIoc < 00 


2.2. Using the inverse for exact-output tracking 

The existence of an inverse (w d ,.\ d ) implies that there are input-state trajectories 
that yield the desired output; exact output tracking is easily achieved by stabilizing 
the desired state trajectory. For example, use w d as feedforward and use the error 
.v- .v d for feedback (see Fig. 2). Stabilization is not the central issue in this paper, 
and any scheme for feedback design can be used. For example, given (A(k),B(k)) 
controllable for all k , the system may be stabilized through pole placement with all 
the closed-loop poles in the same locations for all k. 

Note that typically the initial conditions of the system are different from the 
initial conditions of the desired state trajectory leading to initial transient errors 
typical of all tracking controllers. However, once the desired level of tracking has 
been achieved (due to an exponential reduction in error) our technique will maintain 
tracking across parameter switches. In contrast, switching standard regulators when 
the system parameters change will cause transient errors at the switching instants; 
tracking will not be maintained across swatches. 


2.3. Exact-tracking maintaining input 
We will assume the following. 

Assumption 1: The system A(k), B(k) and C(k) has a well defined vector relative 

degree (Isidori 1989) for each k € Jf\ 



Figure 2. The control scheme. 
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Then we can find a coordinate transformation Q k such that (Isidori 1989) 


~r k (ty 

MO. 


QMO 


'cf 

M. 


x(t) 


where 


Y k (0 ] >’h 


d/('u-i) ■ • -^^-1) y ^ - ■ • m y p 


and r k = [r k{ r k2 . . . r kp ] is the system’s vector relative degree for t k ^ t ^ t k+ i 
(where we assume = — oo). Here C* maps the system states into the outputs and its 
time derivatives and Z p maps the states into the internal dynamics z k . 

Note that a necessary condition for exact output tracking in the interval I k is that 
the system state at time t k is such that 


YkM = YkM 


In addition, to maintain exact tracking we need to ensure that 


Yk(0 = Yk, d(0, V/€[^,^ +1 ) 


Let 

ydA ’ J ' d ' 2 ’ ' " ’ dM) yd ' p 

then we can find the following unique control law (provided that Assumption 1 is 
satisfied) (Isidori 1989): 

u d (t) = F k x(t)+G k y { ^(t) (3) 

such that the time derivative of the output is the same as that of the desired output 
trajectory (this is also a necessary condition for exact output tracking). This exact- 
tracking control is completely determined by the state x{t k ), and by the desired 
output along with its derivatives up to the order r k . 

Substituting the control law (3) into (2) we obtain for t € I k : 

*(0 = A y (k)x(t) + B v (k)y^>(t) (4) 

where A y {k) = A(k) + B(k)F k , B v (k) = B(k)G k . In the transformed coordinates the 
system equations for t € I k are of the form 

n(0 = wo 

m = MkMO + A 2y {k) Y k (t) + B z (k)y™(t) 

Our objective is to define under which conditions it is possible to define a feasible 
state trajectory x d (f) such that exact trajectory tracking is preserved through all the 
time intervals. There are two main hurdles. Firstly, the existence of at least a state 
trajectory which maintains exact output tracking needs to be determined. This 
depends on compatibility of the desired output with the given system. Secondly, 
the state trajectories need to be bounded. In systems with unstable internal dynamics 
(non-minimum-phase systems) generic solutions tend to be unbounded. In this case, 
we need to establish additional conditions for the existence of bounded solutions to 
the internal dynamics. 
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In this paper we restrict ourselves to the case where: Y kd , the output along with 
its time derivatives, has a compact support [7), Tf] G (-oc,oc); ( b ) the switching 
occurs within this compact set; and (c) the internal dynamics are hyperbolic before T i 
and after 7} . More formally, we have the following assumption. 

Assumption 2: The desired output trajectory > r d( ) an d its time derivatives are 

bounded and have compact support S(>’d) = [7, Tf}. The switching in the system 
parameters are at fixed times t k G ( 77, Tf) for every A: G [1, . . . , N]. 

Assumption 3: The system (1) has hyperbolic internal dynamics, i.e. the eigenvalues 

of A z (k) have non-zero real parts (no centres ) for k = 0 and k = N. This is 
equivalent to requiring that the original system (1) have no zeros which lie on the 
imaginary axis ( Isidori 1989) for k — 0 and k = N. 

The last assumption implies the existence of transformations Q 0 and Q N such 
that the system state can be partitioned into 

~Y k (t) i r ct m 

Zsk(t) = QkX(t) = Z sk x(t) (6) 

_ Z u k (0 . _ Z u k _ 

where z sk and z uk are the coordinates for the stable and the unstable subspaces of the 
system’s internal dynamics. 

2.4. Notations 

Towards establishing conditions for the existence of solutions to the exact track- 
ing problem for a prescribed output, we first study the dynamic evolution of the 
system for a given initial condition. 

Given an initial condition in an interval I k , the system’s evolution for 
t k ^ t < t k+] is described by 

x d (t) = exp \A v (k)(t - /*)] x d (t k ) + [ exp [A y (k)(t - r)] fl,.(%d <) ( 7 ') dr 

Jt k 

In a more compact form 

*d(0 = h) x d{h) + h k (t,t k ) 

where 

<Pk(t, tk) = exp [A y (k)(t - t k )\ 

and 

hk{t, t k ) = [ exp [A v (k)(t - t)\ B y (k)y { ' k) (T) dr 

Jt k 

The above equations describe the flow in an interval where the system does not 
undergo switches. To obtain a representation of the system state in terms of an initial 
state that does not belong to the same interval, we define flow compositions as 
follows: 

'FkAt, ti) = $k(t, t k ) o (P k _ { (t k , t k - 1) o ■ • • o #;(//+!, tj) 

k - 1 

H k j(t,ti) = h k (t,t k )-\- ^ *$*k-\ j{tk~\ j tj)hj(tj+\ , tj) 

M 
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where 

and 


YiAt, ti ) = <*>,(/, U) 
H u (t,t i ) = h,(t,t i ) 


The system evolution for an initial condition x(T t ) can be rewritten as 

x(t) = T,)x(Ti) + ffk.oit, T,) 


( 7 ) 


2.5. Necessary and sufficient conditions 
We first formally state the result. 


Lemma 1: Under Assumptions 1-3, the exact output tracking problem is solvable 

with bounded solution if and only if the system of equations: 


Y dk (t k ) = CtQ k 'P k _i. 0 (t k ,T i )Qo ] 


0 

0 


z u,o(Ti) 


+ C£Q k H k ^dt k ,T i ), 


\/k = 


( 

' 0 ' 

\ 

¥Vo(7>, T,)Qo' 

0 

+ /fv, 0 (7>, T t ) 

\ 

Jujo(T,)_ 

) 


,N 

( 8 ) 

( 9 ) 


admits a solution in z„o(T/). 


Proof: System trajectories outside [Ti, 7)], the compact support of Y d, are 

bounded if and only if z Uj y, the unstable component of the internal-dynamics, is 
zero at the end of the motion 7) and similarly the stable component z. 90 is zero 
before time T f . Formally 


x(T,) = Qo' 


0 

0 


z u,o(Tj) 


x(Tf) 


Qx 


0 

z s : x(Tf) 

0 


Substitution of the preceding expressions into (7) computed at t — 7) 

x(T f ) = (T f , TMTi) + H N0 (T f , f) 

gives (9). In addition, exact tracking in every interval I k is possible if it is possible to 
find state trajectories that are continuous and such that C*x(t k ) = Y dk (t k ). By using 
(7), that gives the state at t = t k as a function of the initial state and the constraint on 
x(Ti), (8) easily follows. □ 


Equation (8) will be referred in the following as compatibility conditions, and (9) 
will be referred to as stability condition. The compatibility conditions ensure that Y d 
does not jump across switches (or else unbounded inputs would be required). The 
stability condition ensures that the autonomous system dynamics for t — > ±oc are 
bounded. 
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The algebraic conditions expressed by Lemma 1 can also be interpreted in a 
geometric coordinate-free framework. To this end. let 

k = {.V : Y k = Y AJc {t k )}. *e[0,...,JV] 

represents the set of the admissible system states at time t k to achieve exact tracking 
in the time interval t k ^ t < t k+ \. Z£ k is in general a linear variety in the state space 
that reduces to a linear subspace (the system internal dynamics) for k = 0. 

A necessary condition for achieving exact tracking when t < Tj is x ( fT { ) £ y 0 . 
Furthermore, to maintain a bounded solution for all t < T } it is necessary that the 
initial state belong to the unstable subspace of the system internal dynamics 
x &{Ti) € ££ Wi o- 

Note that every x^(Tj) determines a unique ,x d (r |), given by 

• v d(*l) = ^o(*l> ^i) x d (Tj) + h 0 (t u Ti) 

Hence, we can define the image of the subspace S£* Xi $ as 

*o) ° y* il o — i x : x = *o('it'o).v + h Q (t\, /o); y £ & w .o} 

which represents the linear variety composed by the points reachable at time t\ with 
the constraint of v(t) = Vd(0 f° r f £ [*o, ^i)- 

To maintain exact tracking in the next interval t £ [/|,f 2 )* d is necessary that 
■ v d(^i) £ The compatibility condition at time t = t x states that 

* v d(^i ) £ y ? \ Fi Tj) o y w 0 

which is possible if and only if the linear variety 

n<£ 0 ('b Ti)o& u $ 

is not empty, i.e. if and only if intersects the image of y ? u o under the system flow. 
The same procedure can be repeated for the switching time t = t 2 . Starting from ff \ , 
we can flow forwards in time. To achieve exact tracking in the interval [f 2 <L0’ the 
image of , c /\ must intersect S/ ? 2 , i.e. the set 

Sf 2 = y 2 n &\{h>*\) 0 &\ 

must be not empty and more generally, the exact tracking in t £ [T n t k+ \) is possible 
if and only if the image of k/ k _.\ under the system flow <P k -\ (t k , t k -\) intersects y k , 
i.e. the set 

-A = tfk n $ k -i(t k , t k i) o -A- 1 (10) 

is non-empty for every k = However, to obtain a bounded solution for 

t > T f , the final state at time t = T f must belong to the stable subspace of the 
system internal dynamics J/' SjV . Let 

.'/V,=A ; vn<f,v(7- / -./,)oA 

Hence, we have proved an analogue of Lemma 1 in geometric terms. 


Lemma 2: The exact output tracking problem is solvable if and only if 3/Y, is non- 

empty , i.e. 


U’t, + 0 


( 11 ) 
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As the flow of a linear system is a homeomorphism, the dimension of a linear 
variety and that of its image are equal, and hence 

dim ( < 9 P ,-) ^ dim { ffj), j ^ / 

This means that at each iteration (10) the set of possible solutions could reduce at 
each K and that no solution is possible if it becomes the empty set for some k , i.e. it is 
empty for every / ^ k . 

2.6. Switched systems with invariant internal-dynamics subspace 

We present below a particular case in which the given conditions considerably 
simplify. This exemplifies the obtained results and will be illustrated with an example 
in §5. 

Assumption 4: The system (1) has constant relative degree r = r k for every k, and 

matrix Cjf = C* is constant for every k. 

It follows from the previous assumption that the coordinates outside the internal 
dynamics Y k are the same for every /c, and thus the internal dynamics subspace is the 
same for every k. Note that the stable and unstable subspaces may still be different, 
and may switch around, but are constrained to belong to the same subspace. 

As Y k = C*x, the continuity of x implies that the compatibility conditions are 
always satisfied. 

Lemma 3: If assumption 4 is satisfied , then the compatibility conditions are 

satisfied for every smooth enough (C r ) desired output trajectory v“d(0- 

In addition, <P k (t k +\, t k ) o ff k c & k +\ implies that 

^k+\ — (**+!>**) ° 

is non-empty because 0 € Further dim (//„) = dim (j^ 0w ). 

The additional condition for boundedness of solutions for t > 7) is met if and 
only if S/ N intersects The linear variety ff N can be expressed as 

= Im ( S\j -F v 

and the stable subspace of the internal dynamics can be expressed as 

^ s N = Im (L s N ) 

From the previous considerations we have the following lemma. 

Lemma 4: If Assumptions 1-4 hold, then the exact output tracking problem with 

bounded solution is solvable if 

rank [S N L N J = n z (12) 

where n z is the dimension of the system internal dynamics at t — 7) . 

As a last remark in this section, note that if not only do the internal dynamics 
subspace remain constant across the switchings, as ensured by Assumption 4, but its 
stable and unstable subspaces do too; then the condition (12) is always satisfied and 
the problem has a solution for every admissible Vd(0- Moreover, this solution is 
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unique for every given y d (/). This implies that the exact-tracking problem for a 
system without switches is always solvable. 


3. j d given through an exosystem 

In this section we consider how the preceding results can be specified when the 
reference trajectory is not completely general but is generated through a known 
linear exosystem, given by 


A' e — /t e (/t)A' e l 
3d ~ Q(^)- V e / 


(13) 


First we solve the tracking problem when the initial state of the exosystem (at time 
Tj) is known in advance, hence the obtained result will be valid for the particular 
reference trajectory determined by the initial condition. Later, we will extend the 
approach to the case of unknown initial conditions. In this case, we look for asymp- 
totic tracking of the reference trajectories for arbitrary initial conditions of the 
exosystem. 

We begin by studying the case where the state of the exosystem x c (Tj) is known. 
The system equation (4) becomes 


*d(0 = A y (k)x(l) + B y (k)C*(k)x e (t) (14) 

with v d * (/) = C£(A')x e (/), because all the time derivatives of the output can be 
written in terms of „v c by using (13). 

The system evolution can then be rewritten as 


x(t) = n,o (/, TMT,) + Mxo(k T } ) X'(Ti) 


(15) 


where 


HkAu ti) 
Mm*) 


k-\ 

hk(.U h) + ^k-ljUk-Xi tj)hj (Ovb tj) 

t 7=1 

exp [A v (k)(t - r)] B v (k)Ct{k)V kS >{T> T t ) dr 


and Tf) is the evolution of the exosystem (analogous to (7)). A solution to the 

exact tracking problem exists if Lemma 2 is satisfied. The compatibility condition is 
satisfied for all initial conditions .v d (7}) e if C* = C*. The stability condition 
becomes 

0 = ^ir M .o(T/) +.v 2 .Y e (r f ) (16) 


where 




Si 


ZusVs^Tj, Ti)Qo l 
ZuN H n S){T f , Tj) 


0 

0 

/ 


In what is to follow, we will assume that the above equation has a unique 
solution (iff s’! is invertible). This yields a one-to-one relationship between the plant’s 
state and the exosystem, as follows: 
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Xi(T,) = Qo 1 


0 

0 


Z uJi 


( T, ) 


= Go 


-i 


0 

0 

VW?’/) 


— G(Tj)x e (Tj) 


What is interesting is that we can also write the desired exact tracking state 
trajectory in terms of the exosystem state. By substituting the above expression 
into (15) we obtain 

*d(0 = G(t)x e (t) 


where 

G(l) 4 [v k<Ti ( t , T,)G m + H kJi {t , T i )C*]'F k ] 0 {N, T,)x e (t) (17) 

It may be verified that G(t) satisfies the differential equation 
G k (t) = A y (k)G k (t) - Gj(t)A e (k) + C* 

In the case of no switching, a constant solution always exists for the above Lyapunov 
equation provided that the eigenvalues of the exosystem A e are different from the 
zeros of the plant eigenvalues of A y . The above equation also provides a control 
strategy when the exosystem states are not known. We estimate the state of the 
exosystem as x e and regulate the trajectory x d = G(t)x e . The stability of such a 
controller is studied in the next section. 


4. Stabilization 

If the state of the exosystem x e is not known, then we could estimate it as x e with 
||.Y e (0 - x e (/)|| 2 ^ Ai e e" e '||x e (0) - ie(0)|| 2 . We use x d {l) = G{t)x e {t) as the estimated 
desired state trajectory, and stabilize this trajectory by using the control scheme 
shown in Fig. 3. Note that the feedforward used (see (3)) is completely specified in 
terms of the exosystem’s state estimate, as follows: 

M d = ft-,i*d(0 + F k2 3'd * * ( 0 
= F kA G(t)x e (t) + F k 2 Ct.%(t) 

- FkX e (t) 

The state equations are of the form 

x = A k x + B k (F k x e + K(x - G(t)x e )) 

We require that the system in each interval is either stable or stabilizable. For 
simplicity, we assume that A(k) -f B(k)K is Hurwitz for all k; the arguments remain 
valid if the system is stabilized through any other feedback control scheme. 

The desired trajectory satisfies 

— A k x d + B k F k x c 
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Figure 3 . Trajectory tracking with exosystem. 


Let e := x - .v d . Then the difference between the last two equations yields 
£ = (^k + B k K)e + ( B k F k 4 - B k KG(t))(x c - x e ) 

The exponential stability of the error dynamics system follows from the next lemma. 

Lemma 5: Given the system e = Ae + v(t), where ATj e^ 1 7 < ||e — || 2 < K 2 t nit and 

||v(0ll 2 < K 2 e~ a > { , with K\, K 2 , A3 positive , //*£>;? c = 0 is an exponentially stable 
equilibrium point , provided that a 3 > 02 > 0. 


Proof: 


Using the variation of constants formula 

||e _ ' 4 V( 0 ll 2 < e ( 0 ) + f e ~ Ar 

Jo 

^ lk(°)ll 2 + 1 | e 

<lk(o)|| 2 +f ik 

Jo 


v(r) dr 1 1 
~ Ar v(r) dr 

2 

-^v(r)|| 2 dr 


^ Ik(0)||, + K 2 K, [ e" 2 '" 3 dr 

Jo 

<lk(0)ll 2 + ^3— — 

- Ot 2 


provided that a 3 > a 2 . Hence 


^i||e^V(0ll 2 l|e^W0ll 2 < lk(0)|| 2 + K 2 K, 


a } - a 2 
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the right-hand side being a constant. Therefore, for all e > 0 there exists a positive 
constant K such that 


IKOII2 < * 


5. Example 

Consider the flexible structure, cantilevered at the base and free at the top, shown 
in Fig. 4. It is modelled (with the finite-element method) with a single flexural ele- 
ment. The degrees of freedom are the translational motion at the base xj , and the top 
x 2 , and the rotation at the top x 3 . The input is a translational force at the base and 
the system output is x 2 . The structure is loaded with a mass m t , which is changed at 
several instances. The flexural element has the following properties: mass 420; 
length 1; elastic modulus 1; and cross-sectional area moment of inertia 1. The objec- 
tive is to maintain the top of the structure along a prescribed trajectory to facilitate 
the transfer of the load. The equations of motion can be described by 

M'x + Sx = Bu 


where 



' 156 

54 

-13" 


12 

-12 

6' 

M = 

54 

156 + m, 

-22 

, 5 = 

-12 

12 

-6 


-13 

-22 

4_ 


6 

-6 

4_ 


x = [xi x 2 x 3 ]\ and B = [1 0 0] / . 

In the standard form x = [x x f ]' (abuse of notation) we have the dynamics as 


where 


x = A k x + B k u 

y k = c k x 


A k = 


0 

-M~ [ S 


r 

oj’ 




0 ‘ 

M~ X B 


C k = [ 0 1 0 0 0 0] 


x2 



Figure 4. Example. 
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A* = 


The desired trajectory is generated by an exosystem of the form \* e = A c .v c , where 

0 1 0 O' 

-10 0 0 
0 10 0 
0 0 1 0_ 

and the desired output is v d = [0 0 0 l].v e = C c .v e . We also switch the exosystem to 
— 0 4x4 at the initial and final times T { — 0 and 7) = 2 pi. The first two states of the 
exosystem form an oscillator and the second state is then integrated twice to obtain 
the desired output. Note that ( A c , C e ) is observable. Hence the exosystem states can 
be estimated. In our simulations we ensure that the output trajectories have a 
compact support [0, 27 t] by choosing initial conditions of the exosystem of the 
form x e (Ti) = [0;*;0;0], 

We also switch the mass m t on the structure (see Fig. 4) to take the values m, = 0. 
V/ £ [0, tt/2], m t — 100, V/ £ (7t/ 2. 1 * 5 7r] , and m, — 10, V/ £ (T57r, 2 tt], which denotes 
the jumps in the system. Note that C* remains constant through the switches and 
hence the compatibility conditions are always satisfied. As illustrated in §3, the map 
(7(0) : x c {Tj) — ► x d (T f ) is given as 


(7(0) 


- —4 671 5 

-3-3239 

0 

0 

0 

0 

0 

1 

6-9406 

2-6672 

0 

0 

-0-5935 

-1-4710 

0 

0 

0 

0 

1 

0 

2-6851 

-0-8211 

0 

0 


As an example we simulate the forward dynamics with the initial condition for the 
exosystem as [0 1 0 0]\ The corresponding initial system state for exact output 
tracking is 

^(T,) = [-3-3239 0 2-6672 -1-471 0 - 0-8211]' 

The simulation results are shown in Fig. 5, where the exact tracking state trajec- 
tory is shown; this desired state trajectory yields the desired output with an error of 
10 -6 for a motion of two units. This error is believed to be due to the numerical 
integration schemes. Furthermore, the initial conditions are large and unrealistic. 
The initial conditions of the system are typically not the same as the initial conditions 
of the desired state trajectory; this results in initial transient errors. If the system is 
stabilized then these errors decay exponentially, even if the system dynamics has 
switches. This ability to maintain tracking across switches is a major advantage of 
our approach. Furthermore, preactuation techniques to achieve these initial condi- 
tions (with output error maintained at zero) has been developed by Devasia et al. 
(1996) and we expect to integrate the two approaches in the future. 


6. Conclusions 

The problem of achieving exact output tracking for linear systems that present 
jumps in a parameter's values has been analysed. We have established necessary 
and sufficient conditions for the existence of exact output-tracking bounded state 
trajectories. When the reference trajectory is generated through an exosystem, the 
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, xlO * 6 



Figure 5. Simulation results. 


feedforward action needed to maintain exact tracking can be written as a time- 
varying feedback. Furthermore, this time-varying feedback is related to a map 
from the state of the exosystem to the desired system state. The map is linear and 
is shown to satisfy an ordinary differential equation. For the case of systems without 
switches the presented theory reduces to the standard regulator theory. We also 
showed that the desired trajectory can be stabilized and presented the simulation 
results for an example flexible structure with switching mass. 

Future work will attempt to remove the requirement of compact support for the 
output. There is also a need to address the tracking problem for systems whose 
internal dynamics may not be hyperbolic. 
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